Technical Lead - Data Engineering
About the role
The Technical Lead – Data Engineering will be responsible for leading the design, development, and optimization of large-scale data processing solutions for enterprise operations. The role involves providing technical leadership across data platforms, mentoring engineering teams, and driving best practices in data architecture and software engineering. Key responsibilities include designing and developing enterprise-grade data engineering solutions, leading architecture and implementation of scalable data applications, maintaining ETL pipelines, and collaborating with various stakeholders to define technical solutions. The ideal candidate will have significant experience in data engineering, technical leadership, and hands-on expertise with distributed data processing frameworks and database optimization. The position is based in Sri Lanka and is offered through InTalent Asia for their client in the IT industry. Interested applicants can apply via Easy Apply or by sending a CV to the provided email address.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Experience working within Agile Scrum environments.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- Agile
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Scrum
- Spark
- UML
Highlights
Applicants should send their CV to recruitment14@intalent.asia or use the Easy Apply option. The role is based in Sri Lanka. Experience with cloud platforms, especially AWS, and Big Data technologies is considered advantageous but not mandatory.