Senior Quality Engineer (Forward Deployed)
About the role
Villvay is seeking a Senior Quality Engineer (Forward Deployed) to join their boutique agency focused on digital transformation for B2B eCommerce clients. The role involves hands-on quality engineering, AI and search evaluation, and direct client collaboration. Responsibilities include designing and executing deterministic and non-deterministic tests across web, mobile, and API platforms, presenting evaluation results to stakeholders, and maintaining quality benchmarks. The ideal candidate will have experience in software quality assurance, automation frameworks, and using AI-assisted tools. Villvay offers a hybrid work model, competitive salaries, and various benefits including paid parental and menstrual leave.
Must have
- 4 to 6 years of experience in software quality assurance or test engineering.
- Experience contributing to quality measurement approaches, evaluation and automation frameworks.
- Ability to design, implement, and execute deterministic and non-deterministic testing.
- Web, mobile, and API functional testing experience (automation and manual) across multiple devices and platforms.
- Experience presenting to clients or business stakeholders, with clear, formal written and verbal communication.
- Strong multitasking and context-switching ability across concurrent workstreams.
- Practical use of AI-assisted tools (Cursor, Claude, Rovo, or equivalent), with structured prompts and careful review of AI output before use.
Nice to have
- Ability to turn an unclear quality concern into a defined sample, baseline, test plan, and decision.
- Experience designing, implementing, and executing e-commerce search evaluations using production benchmarks, and analysing results statistically.
- In-depth understanding of search evaluation principles and how search-quality changes affect overall results.
- Prior client-facing or embedded delivery experience.
- Hands-on experience with Elasticsearch, e-commerce platforms, web and API automation tools, performance testing tools, and server interactions.
Technologies
- Agentic AI
- Claude
- Cursor
- DevOps
- E-commerce
- Elasticsearch
- Performance Testing
Highlights
The company offers a hybrid work model, paid parental and menstrual leave, OPD and insurance from the probation period, and opportunities to work with international clients. Villvay is an equal opportunity employer. Application is open to those who are driven by purpose and value professional growth.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka