Lead Engineer
About the role
The Lead AI/ML Engineer will be responsible for identifying gaps in large language model (LLM) capabilities and transforming these into original dataset concepts and high-quality examples. The role involves leading the entire dataset lifecycle, including research, specification, pilot creation, data generation, expert review, validation, and delivery. The engineer will define measurable quality standards, build repeatable workflows that integrate automation and human review, and mentor a multidisciplinary team to ensure consistent, timely delivery of quality datasets. Candidates should have extensive experience in software or data engineering, applied AI, and leadership in technical teams, with a strong background in LLM datasets or evaluation.
Must have
- 7+ years in software engineering, data engineering, applied AI, or related technical roles, including experience relevant to LLM datasets or evaluation
- 3+ years leading technical teams, data development projects, or AI R&D initiatives
- Hands-on experience creating, curating, validating, or evaluating datasets for LLM training, post-training, or benchmarking
- Strong research and experimentation skills: interpreting papers, analyzing model failures, and applying findings to dataset design
- Proven ability to translate ambiguous requirements into dataset specifications, quality criteria, and practical delivery plans
Technologies
- Data Engineering
- LLM
- Machine Learning
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka