Data Engineer Tech Lead
About the role
The Technical Lead – Data Engineering will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations. The role involves providing technical leadership and mentorship to Data Engineers, driving best practices in software engineering, and developing and maintaining ETL pipelines for processing large volumes of structured and unstructured data. The candidate will also be responsible for creating scalable data integration frameworks, optimizing data workflows, and collaborating with various stakeholders to define technical solutions. The position is based in Colombo (Hybrid), within the software industry, and requires strong experience in distributed data processing, database optimization, and technical team leadership.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- Agile
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Spark
- UML
Highlights
The role is hybrid, based in Colombo - 03, with standard Monday to Friday working hours. Applications can be submitted via email to recruitment7@intalent.asia. Experience with cloud platforms, especially AWS, and Big Data technologies is considered an advantage.
Also posted as
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka