Technical Lead - Data Engineering
About the role
The Technical Lead – Data Engineering will be responsible for leading the design, development, and optimization of large-scale data processing solutions for enterprise operations. The role involves providing technical leadership, mentoring engineering teams, driving best practices in data architecture and software engineering, and contributing to scalable data solutions. Key responsibilities include designing and developing enterprise-grade data engineering solutions, leading architecture and implementation of scalable applications, maintaining ETL pipelines, optimizing data workflows, and collaborating with various stakeholders to define technical solutions. The ideal candidate will have significant experience in data engineering, technical leadership, and a strong background in distributed data processing frameworks and database optimization.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Experience working within Agile Scrum environments.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- Agile
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Scrum
- Spark
- UML
Highlights
Applicants can apply by clicking 'Easy Apply' or by sending their CV to recruitment14@intalent.asia. The position is based in Sri Lanka. Experience with cloud platforms, particularly AWS, and Big Data technologies is considered an advantage.