GA

Senior QA Engineer (AI Testing)

Gallagherlinkedin.com
Nov 19, 2026, 12:01 AM23h ago
Full-timeColombo, Western ProvinceQASenior

About the role

The Senior QA Engineer (AI Testing) at Gallagher is responsible for ensuring the quality and reliability of AI-enabled solutions throughout their lifecycle, including testing, evaluation, and production monitoring. The role involves developing and maintaining test strategies, evaluating AI behaviour for accuracy and safety, testing for AI-specific risks, building automated regression suites, and integrating them into CI/CD pipelines. The position also requires collaboration with stakeholders to clarify requirements and communicate quality risks, as well as monitoring AI quality in production and staying updated on industry trends. The role is based in Colombo, Sri Lanka and reports to the QA Practice Lead.

Must have

  • Proven experience in software testing, including AI-specific testing.
  • Expertise in AI risks, retrieval-augmented generation, and prompt engineering.
  • Familiarity with secure software engineering practices and Agile methodologies.
  • Experience with performance, accessibility, and security testing.
  • Knowledge of CI platforms (e.g., Azure DevOps) and tools like Postman and JMeter.

Nice to have

  • ISTQB certification and training in AI or machine learning are advantageous.

Technologies

  • Accessibility
  • Agile
  • Azure DevOps
  • CI/CD
  • Generative AI
  • Istqb
  • JMeter
  • Machine Learning
  • Postman
  • Prompt Engineering
  • RAG

Highlights

The position is based in Colombo, Sri Lanka. ISTQB certification and training in AI or machine learning are considered advantageous but not mandatory.