Associate Technical Lead – Data Engineering
About the role
The Associate Technical Lead – Data Engineering will be responsible for designing and developing scalable data engineering solutions for enterprise applications. The role involves implementing distributed data processing applications, managing large volumes of structured and unstructured data, developing ETL processes and data pipelines, and working with cloud-based data platforms, particularly AWS. The position also requires ensuring high code quality, supporting CI/CD practices, collaborating within Agile teams, and guiding team members on technical direction and best practices. Applicants should have a strong background in Python, Shell Scripting, SQL, AWS services, and experience with ETL and cloud data tools. The role is offered on a renewable contract basis, initially for 6 months, with the possibility of extension based on performance. The position is based in Colombo (hybrid working), and applications can be submitted via email or easy apply.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- Minimum 4+ years of experience in developing enterprise-grade data processing applications.
- Strong programming experience in Python, Shell Scripting, and SQL.
- Experience working with streaming data technologies such as Kafka.
- Strong hands-on experience with AWS services including: Redshift, RDS (PostgreSQL), DMS, Lambda, EC2, S3.
- Experience processing and managing large data volumes.
- Hands-on experience with relational databases, NoSQL databases, and distributed storage platforms.
- Strong experience in ETL design and development.
- Experience with ETL and cloud data tools such as: Informatica, AWS Data Pipeline, AWS Glue, Lambda, EMR, Spark, Hive.
- Experience working in Agile Scrum environments.
- Familiarity with DevOps practices and modern engineering workflows.
- Experience with source code management and CI/CD tools such as: GitHub, GitLab, Jenkins.
- Experience guiding team members on technical implementation approaches and engineering standards.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management capabilities.
- Strong willingness to learn, adapt, and continuously improve technical capabilities.
Nice to have
- Experience with API development.
- Exposure to user interface technologies such as: Node.js, Angular, HTML.
- Experience working with modern cloud-native architectures and distributed systems.
Technologies
- Agile
- Angular
- AWS
- AWS Glue
- Bash
- CI/CD
- Cloud Native
- Data Engineering
- Data Pipelines
- DevOps
- EC2
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- AWS Lambda
- Node.js
- NoSQL
- PostgreSQL
- Python
- RDS
- Redshift
- S3
- Scrum
- Spark
- SQL
Highlights
The role is based in Colombo 04 with a hybrid working arrangement. Working hours are Monday to Friday, local standard hours. The employment is on a renewable contract basis, starting with an initial 6-month contract that may be extended to a 1-year renewable contract based on performance. Applications are accepted via recruitment7@intalent.asia or through easy apply.
Also posted as
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka