Workiy Logo

Workiy

QA Lead – Agentic AI Platform

Posted 17 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in CAN
Senior level
Remote
Hiring Remotely in CAN
Senior level
Lead QA for an Agentic AI platform: define and execute testing strategy, implement automation, validate LLM outputs and conversational workflows, oversee functional/integration/regression/performance testing, integrate CI/CD, mentor QA engineers, and promote quality best practices across teams.
The summary above was generated by AI

This is a remote position.

Job Description :

We are seeking an experienced QA Lead to oversee quality assurance efforts for a next-generation Agentic AI platform. The ideal candidate will be responsible for defining and executing comprehensive testing strategies that ensure the reliability, accuracy, scalability, and performance of AI-driven applications. This role requires close collaboration with product managers, software engineers, data scientists, and business stakeholders to validate end-to-end system functionality and deliver high-quality releases.

The QA Lead will drive the implementation of automated testing frameworks, establish quality standards and release criteria, and oversee functional, integration, regression, performance, and user acceptance testing activities. The role also involves validating AI model outputs, conversational workflows, API integrations, data pipelines, and overall user experience. Candidates should possess strong leadership skills, hands-on experience with test automation, API testing, CI/CD processes, and data validation, along with a deep understanding of Agile development practices.

The successful candidate will mentor QA engineers, promote quality best practices across teams, identify risks early in the development lifecycle, and continuously improve testing processes to support the delivery of robust, enterprise-grade AI solutions. Experience with Generative AI, Large Language Models (LLMs), Agentic AI systems, cloud platforms, and modern software quality engineering methodologies is highly preferred.



Requirements
  • AI/LLM Testing and Validation
  • Agentic AI and Conversational AI Platforms
  • Test Automation Frameworks (Selenium, Playwright, Cypress, or equivalent)
  • API Testing (REST, GraphQL)
  • Python or Java for Test Automation
  • Data Quality and Data Validation Testing
  • SQL and Database Testing
  • CI/CD Pipeline Integration (Jenkins, GitHub Actions, GitLab CI)
  • Functional, Integration, Regression, and End-to-End Testing
  • Performance and Load Testing
  • Defect Management and Test Planning
  • Quality Strategy, Release Gates, and Risk-Based Testing
  • Agile/Scrum Methodologies
  • QA Leadership and Team Mentoring
  • Strong Analytical and Problem-Solving Skills
  • Experience with Cloud Platforms (AWS, Azure, or GCP)


Similar Jobs

3 Hours Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead production database troubleshooting and performance tuning across multi-tenant PostgreSQL/MariaDB fleets. Own incident RCAs, develop observability and automation, influence infrastructure decisions, mentor cross-functional engineers, and support large-scale web distributed applications and Linux-based environments in cloud and on-prem deployments.
Top Skills: AnsibleApacheCi/CdCloud InfrastructureContainersJavaScriptJbossKubernetesLinuxMariadbPaasPostgresPythonSaaSServicenowShell ScriptingTomcatWeblogicWebsphere
9 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
The Senior Software Engineer will manage data systems, develop scalable pipelines, ensure data security, and build self-service applications for users at Coinbase.
Top Skills: AirflowGoJavaKafkaPythonSparkSQL
9 Hours Ago
Easy Apply
Remote
Canada
Easy Apply
Senior level
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead design and delivery of backend risk systems to detect and prevent fraud, manage credit and market risk, and protect users. Drive architecture for distributed, high-availability services, partner with Data Science/ML and product teams, build AI-native detection and response systems, mentor engineers, own operational excellence, and lead incident response and post-mortems.
Top Skills: Event-Driven ArchitectureGenerative AiGoGraphQLJavaMicroservicesPythonRest ApisRuby

What you need to know about the Calgary Tech Scene

Employees can spend up to one-third of their life at work, so choosing the right company is crucial, not just for the job itself but for the company culture as well. While startups often offer dynamic culture and growth opportunities, large corporations provide benefits like career development and networking, especially appealing to recent graduates. Fortunately, Calgary stands out as a hub for both, recognized as one of Startup Genome's Top 100 Emerging Ecosystems, while also playing host to a number of multinational enterprises. In Calgary, job seekers can find a wide range of opportunities.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account