Senior Data Engineer

Capital Alliance PLCtopjobs.lk

Nov 6, 2026, 11:31 AM2h ago

Full-timeColombo 2Data engineeringSenior (5+ yrs)

Apply on topjobs.lk

About the role

The Senior Data Engineer role at CAL involves building and optimizing scalable data pipelines and cloud data platforms to support real-time analytics and decision-making. Key responsibilities include developing batch and incremental ETL/ELT pipelines, designing medallion data layers, monitoring and troubleshooting production pipelines, delivering high-quality datasets for analytics and data science teams, and collaborating in an Agile environment. Candidates should have a degree in Computer Science, IT, Big Data, or a related field, and at least 5 years of hands-on data engineering experience with big data or cloud platforms. Strong skills in Python or Java, SQL, and experience with tools such as Snowflake, Hadoop, AWS, Airflow, Oozie, or Informatica are required, along with proven experience in implementing CDC, SCD, and medallion architectures.

Must have

Degree in Computer Science, IT, Big Data or a related field, or equivalent experience
5+ years of hands-on data engineering on big data or cloud data platforms
Strong production experience with Snowflake (preferred), Hadoop (HDFS) or AWS (S3)
Strong Python or Java; hands-on with PySpark, Spark SQL or Snowpark
Advanced SQL (MySQL, SQL Server or Oracle), including query tuning and optimization
Production experience with Airflow (preferred), Oozie or Informatica
Proven experience implementing CDC, SCD and medallion architectures
Track record of troubleshooting production pipelines and reducing compute and storage costs
Git, CI/CD and code review experience

Technologies

Agile
Airflow
AWS
CI/CD
Data Engineering
Data Science
ELT
ETL
Git
Hadoop
Java
MySQL
Oracle
PySpark
Python
S3
Snowflake
Snowpark
Spark
SQL
SQL Server

Highlights

Production experience with Airflow is preferred. Snowflake experience is also preferred. The role requires hands-on experience with big data or cloud platforms and advanced SQL skills. Applications can be submitted via cal.lk/careers.