Technical Lead - Data Engineering
About the role
The Technical Lead - Data Engineering will be responsible for leading engineering teams in the design, development, and optimization of complex data models, data flows, and AI-driven features. The role involves overseeing the full software development lifecycle for data ingestion, transformation, and delivery, as well as integrating AI-driven monitoring and automation tools. The Technical Lead will manage cloud data infrastructure across GCP and AWS, ensure security compliance, drive cost optimization, and lead incident response and operational stability. The position also includes mentoring engineers, conducting technical reviews, and collaborating with global stakeholders.
Must have
- Bachelor’s degree in CS or equivalent, plus 6+ years of experience in data engineering, including 2+ years leading engineering teams.
- Mastery of Python, SQL, Shell scripting, Medallion architecture, advanced dimensional modeling, real-time data streaming, GCP/AWS cloud stacks, CI/CD/DevOps practices.
- Experience in working with FinOps fundamentals for effective cost management.
- Capability to drive team-wide adoption of AI-assisted operational and engineering tools.
- Experience in leading engineering teams in data modeling, ETL design and development, streaming data in cloud data environments, using various ETL tools and technologies.
- Leading engineers in working in a Scrum/Agile delivery environment.
- Demonstrates strong self-management on assigned tasks; collaborates effectively with QA, DevOps, and Business Analysts.
- Experience in cloud infrastructure security, including keeping EC2 instances and other cloud components up to date, applying security patches, addressing vulnerabilities, and maintaining compliance with organizational security standards.
- Strong communication and interpersonal skills, with the ability to influence and effectively communicate technical concepts and decisions.
- Hands-on experience in working closely with non-technical people and sound knowledge of the technical and business domains
Nice to have
- Experience in API development would be an added advantage.
Technologies
- Agentic AI
- Agile
- AWS
- Bash
- BigQuery
- CI/CD
- CloudFormation
- Cybersecurity
- Data Engineering
- Data Modeling
- DevOps
- Dimensional Modeling
- EC2
- ETL
- FinOps
- GCP
- GKE
- IAM
- Infrastructure as Code
- AWS Lambda
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL
- Terraform
- Test Automation
Highlights
The role requires aligning part of the workday with international time zones for meetings and collaboration with overseas stakeholders. On-call support may be required for production incident responses.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka