Data Engineer Tech Lead
About the role
The Technical Lead – Data Engineering will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations. The role involves providing technical leadership and mentorship to data engineers, driving best practices in software engineering, and developing and maintaining ETL pipelines for processing large volumes of structured and unstructured data. The position requires strong expertise in distributed data processing frameworks, database development and optimization, and experience in leading technical teams. The role is based onsite in Colombo and is offered on a renewable contract basis, initially for 6 months with the possibility of extension based on performance. The employer is InTalent Asia, recruiting for a client in the software industry. Interested candidates are encouraged to send their CV to the provided email address or apply via the easy apply link.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- Agile
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Spark
- UML
Highlights
The position is onsite in Colombo 03, with standard Monday to Friday working hours. The employment is on a renewable contract basis, starting with an initial 6-month contract that may be extended to a 1-year renewable contract based on performance. Applications should be sent to recruitment7@intalent.asia.