HA

Associate Technical Lead- Data Engineering

Hatchyarditpro.lk
Oct 22, 2026, 12:40 AM5d ago
Full-timeColomboData engineeringLead (4+ yrs)

About the role

The Associate Technical Lead - Data Engineering role involves developing enterprise-grade data processing applications, with a focus on programming for data operations, handling streaming data, and working with AWS data services. The position requires hands-on experience with large data volumes, relational and NoSQL databases, distributed storage engines, and ETL design and development using various tools. The role also involves working in a Scrum Agile environment and utilizing DevOps practices, including code management and CICD tools.

Must have

  • A Bachelor's Degree in Computer Science or equivalent, and 4+ years of experience in developing enterprise grade data processing applications.
  • A strong programming background in data ops (Python, Shell, SQL).
  • Experience in working with streaming data (Kafka).
  • Strong hands-on experience with AWS data services including Redshift, RDS (PostgreSQL), DMS, Lambda, EC2 and S3.
  • Experience in processing large volumes of data.
  • Hands-on experience in working with relational/NoSQL databases and distributed storage engines (HDFS, S3, Redshift).
  • Hands-on experience in ETL design and development using ETL tools (Preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive).
  • Experience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantage.
  • Working in a Scrum Agile delivery environment and DevOps practices.
  • Experience in code management and CICD tools such as Github, Gitlab, Jenkins.

Technologies

  • Agile
  • Angular
  • AWS
  • Bash
  • CI/CD
  • Data Engineering
  • Data Pipelines
  • DevOps
  • EC2
  • ETL
  • GitHub
  • GitLab
  • Hive
  • HTML
  • Jenkins
  • Kafka
  • AWS Lambda
  • Node.js
  • NoSQL
  • PostgreSQL
  • Python
  • RDS
  • Redshift
  • S3
  • Scrum
  • Spark
  • SQL