Role overview

Position Overview

The Senior Systems Testing/QA Specialist (QA Lead) is responsible for planning, coordinating, executing, and overseeing quality assurance activities for application delivery. The role covers functional and automated testing, performance and accessibility testing, and specialized testing of AI-enabled systems. The successful candidate will help ensure solutions meet business requirements, technical expectations, and quality standards.
Key Responsibilities Quality Assurance Leadership

Lead testing activities for assigned projects, including planning, coordination, execution, and oversight.
Assess quality risks based on verification and validation results and recommend mitigation strategies.
Implement and maintain quality processes supporting development and production change management.

Test Design and Planning

Develop master test plans, test plans, test cases, test scripts, and test completion reports.
Design manual and automated tests, including functional, system, regression, integration, load, and performance scenarios.
Work with development leads and business analysts to prepare suitable test data.
Advise and support business users in developing User Acceptance Testing (UAT) test cases.

Test Execution and Management

Execute functional, regression, integration, usability/accessibility, performance, and other required tests manually and/or using automation tools.
Conduct AI testing, including functional AI testing, response accuracy, hallucination testing, prompt testing, AI security and privacy testing (including prompt injection), and AI safety testing for inappropriate behaviours.
Manage test cycles, monitor progress, track issues, coordinate defect resolution, and maintain detailed test results and discrepancy records.

Coordination and Collaboration

Coordinate with project managers, implementation teams, system administrators, architects, vendors, and database administrators to align testing with timelines and technical requirements.
Lead or support business users during UAT and provide guidance as required.

Reporting and Communication

Document and communicate defects and test discrepancies to relevant stakeholders throughout the testing lifecycle.
Provide regular updates on testing progress, issues, and outcomes to project teams and management.
Prepare a Test Completion Report summarizing testing activities and results for project gating decisions.

Required Qualifications and Experience

Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.
10+ years of experience testing large-scale applications, including on-premises web solutions, cloud-based integrations, and mobile platforms.
At least 3 years of hands-on AI-assisted testing experience, including developing AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications to create and execute test cases.
Experience using AI tools to improve test coverage, negative testing, and regression testing, with knowledge of AI-assisted automation for CI/CD pipelines.
Experience leading and coordinating testing activities with project teams and a strong understanding of SDLC delivery approaches, including Waterfall, Agile/Scrum, Hybrid, and DevOps.
Strong analytical skills across business processes, information systems, information management, web UI design, and accessibility.
Excellent written and verbal communication skills and the ability to work effectively with multidisciplinary teams.
Certification in Software Quality Engineering or an equivalent credential is considered an asset.

Technical Capabilities

Hands-on experience across UI, integration, regression, performance, AI-enabled systems, and UAT testing for web, mobile, and cloud platforms.
Experience with AI testing tools and technologies such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, agentic AI, and Copilot Studio Kit.
Automated testing experience with Micro Focus UFT, TOSCA, Selenium, and Cucumber.
Performance testing experience with JMeter and OpenText LoadRunner.
Experience with defect and test management tools such as OpenText ALM, OpenText Octane, JIRA, Visual Studio, and Confluence.
Experience with ServiceNow, Salesforce, SAP, or equivalent platforms is considered an asset.
Ability to analyze business requirements and user stories, design test scenarios, develop test cases and scripts, prepare test data, and assess results.

Key Deliverables

Develop detailed manual and automated test plans, test cases, and test scripts aligned with business requirements and project objectives.
Execute functional, regression, integration, system, performance, usability, and UAT testing across platforms and environments; document and report results.
Maintain accurate records of defects and test discrepancies using designated QA tools and provide timely reports and recommendations.
As needed, develop and implement automated testing frameworks and scripts using tools such as Micro Focus/OpenText UFT, Selenium, and Cucumber.
As needed, conduct load and stress testing using LoadRunner or JMeter and provide performance analysis reports with actionable recommendations.
Collaborate with business analysts and developers to create and manage test data and scenarios for robust business-process validation.
Support QA processes and continuous improvement across Agile, DevOps, and traditional delivery environments.

Must-Have Requirements

3+ years of solid AI-assisted testing experience, including hands-on development of AI-powered QA agents using agentic AI, LLM technologies, and chatbot applications.
10+ years of testing experience with large-scale applications across on-premises web solutions, cloud integrations, and mobile platforms.
Extensive hands-on testing experience across UI, integration, regression, performance, AI-enabled systems, and UAT for web, mobile, and cloud platforms.
Practical experience with AI testing tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, agentic AI, and/or Copilot Studio Kit.