Associate Technical Lead - Data Engineering
About the role
The Associate Technical Lead – Data Engineering will be responsible for designing and developing scalable data engineering solutions for enterprise applications, implementing distributed data processing applications, and managing large volumes of structured and unstructured data. The role involves designing ETL processes, building data pipelines, integrating solutions, and working with cloud-based data platforms, particularly AWS. The position also requires ensuring high code quality, supporting CI/CD practices, collaborating in Agile environments, and guiding team members on technical direction and best practices. The employer is InTalent Asia, recruiting for a client in the technology and software engineering industry, with the role based in Colombo, Sri Lanka on a contract and hybrid basis.
Must have
- Bachelor's Degree in Computer Science or an equivalent qualification.
- Minimum 4+ years of experience in developing enterprise-grade data processing applications.
- Strong programming experience in Python, Shell Scripting, and SQL.
- Experience working with streaming data technologies such as Kafka.
- Strong hands-on experience with AWS services including: Redshift, RDS (PostgreSQL), DMS, Lambda, EC2, S3
- Experience processing and managing large data volumes.
- Hands-on experience with relational databases, NoSQL databases, and distributed storage platforms.
- Strong experience in ETL design and development.
- Experience with ETL and cloud data tools such as: Informatica, Hive, AWS Data Pipeline, AWS Glue, Lambda, EMR, Spark
- Experience working in Agile Scrum environments.
- Familiarity with DevOps practices and modern engineering workflows.
- Experience with source code management and CI/CD tools such as: GitHub, GitLab, Jenkins
- Experience guiding team members on technical implementation approaches and engineering standards.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management capabilities.
- Strong willingness to learn, adapt, and continuously improve technical capabilities.
Nice to have
- Experience with API development.
- Exposure to user interface technologies such as: Node.js
- Angular
- HTML
- Experience working with modern cloud-native architectures and distributed systems.
Technologies
- Agile
- Angular
- AWS
- AWS Glue
- Bash
- CI/CD
- Cloud Native
- Data Engineering
- Data Pipelines
- DevOps
- EC2
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- AWS Lambda
- Node.js
- NoSQL
- PostgreSQL
- Python
- RDS
- Redshift
- S3
- Scrum
- Spark
- SQL
Highlights
The position is hybrid, requiring some on-site presence in Colombo, Sri Lanka. The employer is a recruitment partner (InTalent Asia) hiring for a client. The role is contract-based. Application details are not specified in the listing.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka