Technical Lead – Data Engineering
About the role
The Technical Lead – Data Engineering will be responsible for leading the design, development, and delivery of enterprise-scale data engineering solutions. The role involves translating business requirements into technical specifications, designing scalable data models and pipelines, guiding engineering teams, optimizing platform performance, and ensuring best practices in CI/CD and DevOps. The position also includes mentoring data engineers, collaborating with stakeholders, and supporting cloud cost optimization initiatives. The company is seeking a hands-on technical leader with strong expertise in data engineering, cloud technologies, architecture, and people leadership.
Must have
- Bachelor's degree in Computer Science, Engineering, or an equivalent qualification.
- 6+ years of experience in Data Engineering, with 2+ years in a technical/team leadership capacity.
- Strong hands-on experience in Python, SQL, and Shell scripting.
- Strong experience in ETL/ELT, data modelling, data pipelines, and large-scale data processing.
- Hands-on experience with Apache Spark and/or Dataflow.
- Strong knowledge of relational databases, query optimization, and database design.
- Experience with GCP and/or AWS cloud platforms.
- Experience with BigQuery, Redshift, or similar cloud data platforms.
- Strong understanding of CI/CD, DevOps, Agile/Scrum, and software engineering best practices.
- Experience leading and mentoring Data Engineering teams.
- Knowledge of cloud infrastructure, security, scalability, and performance optimization.
- Strong communication and stakeholder management skills, with the ability to explain complex technical concepts to non-technical stakeholders.
Nice to have
- Understanding of FinOps and cloud cost optimization will be an advantage.
- Experience with Terraform/CloudFormation, NoSQL databases, API development, or real-time streaming will be an added advantage.
Technologies
- Agile
- AWS
- Bash
- BigQuery
- CI/CD
- CloudFormation
- Data Engineering
- Data Modeling
- Data Pipelines
- DevOps
- ELT
- ETL
- FinOps
- GCP
- GKE
- IAM
- NoSQL
- Python
- Redshift
- S3
- Scrum
- SDLC
- Spark
- SQL
- Terraform
- Test Automation
Highlights
Candidates are encouraged to apply through LinkedIn or by sending their CV to recruitment2@intalent.asia. The role may require aligning working hours with international teams. Understanding of FinOps and experience with Terraform/CloudFormation, NoSQL, API development, or real-time streaming are considered advantageous.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka