Technical Lead – Data Engineering
About the role
The Technical Lead – Data Engineering will be responsible for leading the design, development, and delivery of enterprise-scale data engineering solutions. The role involves translating business requirements into technical specifications, leading engineering teams, optimizing data pipelines and platform performance, and ensuring best practices in CI/CD, DevOps, and software engineering. The position requires hands-on work with cloud technologies (GCP, AWS), data platforms (BigQuery, Redshift), and tools such as Apache Spark and Dataflow. The Technical Lead will also mentor team members, collaborate with international stakeholders, and support cloud cost optimization initiatives.
Must have
- Bachelor's degree in Computer Science, Engineering, or an equivalent qualification.
- 6+ years of experience in Data Engineering, with 2+ years in a technical/team leadership capacity.
- Strong hands-on experience in Python, SQL, and Shell scripting.
- Strong experience in ETL/ELT, data modelling, data pipelines, and large-scale data processing.
- Hands-on experience with Apache Spark and/or Dataflow.
- Strong knowledge of relational databases, query optimization, and database design.
- Experience with GCP and/or AWS cloud platforms.
- Experience with BigQuery, Redshift, or similar cloud data platforms.
- Strong understanding of CI/CD, DevOps, Agile/Scrum, and software engineering best practices.
- Experience leading and mentoring Data Engineering teams.
- Knowledge of cloud infrastructure, security, scalability, and performance optimization.
- Strong communication and stakeholder management skills, with the ability to explain complex technical concepts to non-technical stakeholders.
Nice to have
- Understanding of FinOps and cloud cost optimization will be an advantage.
- Experience with Terraform/CloudFormation, NoSQL databases, API development, or real-time streaming will be an added advantage.
Technologies
- Agile
- AWS
- Bash
- BigQuery
- CI/CD
- CloudFormation
- Data Engineering
- Data Modeling
- Data Pipelines
- DevOps
- ELT
- ETL
- FinOps
- GCP
- GKE
- IAM
- NoSQL
- Python
- Redshift
- S3
- Scrum
- SDLC
- Spark
- SQL
- Terraform
- Test Automation
Highlights
Candidates are encouraged to apply via LinkedIn or by sending their CV to recruitment2@intalent.asia. The role may require aligning working hours with overseas teams. Understanding of FinOps and experience with Terraform/CloudFormation, NoSQL, API development, or real-time streaming are considered advantages.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka