Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Reposted 11 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

6 Hours Ago
Remote or Hybrid
Calgary, AB, CAN
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Hunt and close net-new enterprise accounts across Alberta, building executive relationships and value-based business cases. Drive pipeline via prospecting, partners, and events; lead complex sales cycles with Sales Engineers and Customer Success to deliver observability, security, cloud modernization, and AI-driven outcomes.
Top Skills: AiopsAWSAzureCloud MigrationCybersecurityDevOpsDynatraceGCPObservabilityPlatform Engineering
9 Hours Ago
Remote or Hybrid
Canada
Senior level
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Design, deploy, and operate enterprise network infrastructure across data centers and cloud (GCP, AWS, Azure). Manage VPCs, VPNs, BGP, F5 BIG-IP, hybrid connectivity, and observability. Build IaC and automation with Terraform, GitLab CI/CD, and Ansible. Maintain monitoring, documentation, and participate in on-call support for critical incidents.
Top Skills: AnsibleAWSAzureBgpCloud RouterCloudflareDnsF5 Big-IpFirewallsGCPGitlab Ci/CdHa VpnIp Address ManagementIpsec VpnLoad BalancingTerraformVpc
10 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Expert/Leader
Expert/Leader
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead high-impact reliability projects to improve resiliency, scalability, and deployment safety for thousands of services. Build secure configuration and secrets systems, improve canary-based release systems, partner with critical teams to reduce operational toil, drive observability and reliability best practices, participate in on-call rotations, and communicate architecture decisions to stakeholders.
Top Skills: AWSAzureDatadogGCPGenerative AiGoKibanaRubyTerraform

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account