Technical Lead - Data Engineering
About the role
The Technical Lead - Data Engineering will lead engineering teams in designing, developing, and optimizing complex data models, data flows, and features for data engineering tasks, leveraging AI accelerators where available. The role involves overseeing the full software development lifecycle for data ingestion, transformation, and delivery, integrating AI-driven monitoring and automation tools, and ensuring secure, cost-effective cloud data infrastructure across GCP and AWS. The Technical Lead will also drive adoption of engineering standards, manage production incidents, and collaborate with cross-functional teams to align priorities and resolve technical challenges. The position requires strong leadership in technical reviews, performance management, and career development for data engineers, as well as effective communication with stakeholders across international time zones.
Must have
- Bachelor’s degree in CS or equivalent, plus 6+ years of experience in data engineering, including 2+ years leading engineering teams.
- Mastery of Python, SQL, Shell scripting, Medallion architecture, advanced dimensional modeling, real-time data streaming, GCP/AWS cloud stacks, CI/CD/DevOps practices.
- Experience in working with FinOps fundamentals for effective cost management.
- Capability to drive team-wide adoption of AI-assisted operational and engineering tools.
- Experience in leading engineering teams in data modeling, ETL design and development, streaming data in cloud data environments, using various ETL tools and technologies.
- Leading engineers in working in a Scrum/Agile delivery environment.
- Demonstrates strong self-management on assigned tasks; collaborates effectively with QA, DevOps, and Business Analysts.
- Experience in cloud infrastructure security, including keeping EC2 instances and other cloud components up to date, applying security patches, addressing vulnerabilities, and maintaining compliance with organizational security standards.
- Strong communication and interpersonal skills, with the ability to influence and effectively communicate technical concepts and decisions.
- Hands-on experience in working closely with non-technical people and sound knowledge of the technical and business domains.
Nice to have
- Experience in API development would be an added advantage.
Technologies
- Agentic AI
- Agile
- AWS
- Bash
- BigQuery
- CI/CD
- CloudFormation
- Cybersecurity
- Data Engineering
- Data Modeling
- DevOps
- Dimensional Modeling
- EC2
- ETL
- FinOps
- GCP
- GKE
- IAM
- Infrastructure as Code
- AWS Lambda
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL
- Terraform
- Test Automation
Highlights
The role requires aligning part of the workday with international time zones for meetings and collaboration. On-call support may be required for production incident responses. The position is part of a global team and involves collaboration with overseas stakeholders.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka