Data Engineer Tech Lead
About the role
The Technical Lead – Data Engineering will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations. The role involves providing technical leadership and mentorship to data engineers and development teams, driving best practices in software engineering, and developing and maintaining ETL pipelines for processing large volumes of structured and unstructured data. The candidate will also be expected to design distributed data processing solutions, optimize workflows and database performance, and collaborate with various stakeholders to define technical solutions. The position is offered on a renewable contract basis, initially for 6 months with the possibility of extension based on performance, and is based onsite in Colombo 03. Applicants are encouraged to send their CVs to recruitment7@intalent.asia.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- Agile
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Spark
- UML
Highlights
This is an onsite role in Colombo 03 with standard Monday to Friday working hours. The employment is on a renewable contract basis, starting with an initial 6-month contract that may be extended to a 1-year renewable contract based on performance. Applications can be submitted via email to recruitment7@intalent.asia.