Technical Lead - Data Engineering
A newer copy of this job is live on linkedin.com.View latest
About the role
The Technical Lead – Data Engineering will be responsible for leading the design, development, and optimization of large-scale data processing solutions for enterprise operations. The role involves providing technical leadership to engineering teams, mentoring team members, and driving best practices in data architecture and software engineering. Key responsibilities include designing scalable data platforms, developing and maintaining ETL pipelines, optimizing data workflows, and collaborating with various stakeholders to define technical solutions. The position is with InTalent Asia's client in the Information Technology sector, based in Sri Lanka. Candidates are encouraged to apply via Easy Apply or by sending their CV to the provided email address.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- 5–6+ years of experience developing enterprise-grade data processing applications and integration solutions.
- Previous experience leading technical teams and mentoring engineers.
- Strong experience processing large volumes of data using distributed data processing frameworks.
- Hands-on expertise in Apache Spark and large-scale ETL development.
- Strong database development and optimization experience, preferably using MySQL.
- Strong understanding of database architecture, OLTP, OLAP, indexing strategies, query optimization, and performance tuning.
- Experience developing scalable data pipelines, integration platforms, and enterprise data solutions.
- Strong software engineering background with knowledge of design patterns, UML, and enterprise architecture principles.
- Experience working within Agile Scrum environments.
- Good understanding of DevOps principles, source control, and CI/CD methodologies.
- Strong analytical and problem-solving capabilities.
- Excellent leadership, communication, and stakeholder management skills.
- Ability to influence technical direction and drive engineering excellence across teams.
- Passion for data engineering, innovation, and continuous learning.
Nice to have
- Experience with Big Data technologies such as Hadoop, Elasticsearch, CouchDB, MongoDB, or similar platforms will be an advantage.
- Experience working with cloud platforms, particularly AWS, will be an added advantage.
Technologies
- Agile
- AWS
- CI/CD
- CouchDB
- Data Engineering
- Data Pipelines
- DevOps
- Elasticsearch
- ETL
- Hadoop
- MongoDB
- MySQL
- Scrum
- Spark
- UML
Highlights
Applications can be submitted by clicking 'Easy Apply' or by emailing recruitment14@intalent.asia. The role is based in Sri Lanka. Experience with cloud platforms, especially AWS, and Big Data technologies is considered advantageous.