Data Engineer Tech Lead
About the role
The Technical Lead – Data Engineering will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations. The role involves providing technical leadership and mentorship to Data Engineers and development teams, driving best practices in software engineering, and leading technical discussions on data architecture and infrastructure. Key responsibilities include developing and maintaining ETL pipelines, creating scalable data integration frameworks, optimizing data workflows, and ensuring the reliability and performance of data platforms. The ideal candidate will have significant experience in data processing, technical team leadership, and expertise in technologies such as Apache Spark and MySQL. The position is based in Colombo (Hybrid) and is within the software industry. Interested candidates are encouraged to apply via email or the provided application link.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Spark
- UML
Highlights
The role is hybrid, based in Colombo 03, with standard Monday to Friday working hours. Applications should be sent to recruitment7@intalent.asia or via the 'easy apply' link. Experience with AWS and Big Data technologies is advantageous but not mandatory.
Also posted as
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka