Data Engineer
About the role
The Data Engineer role at CAL involves designing, building, and optimizing scalable data pipelines and cloud data platforms to support real-time analytics and decision-making. Key responsibilities include building and optimizing ETL/ELT pipelines, designing data layers with medallion architecture, monitoring and troubleshooting production pipelines, delivering high-quality datasets to analytics teams, and writing clear documentation while working in an Agile environment. Candidates should have a relevant degree and experience with big data or cloud platforms, as well as proficiency in SQL and programming languages such as Python or Java.
Must have
- Degree in Computer Science, IT, Big Data or a related field
- 1–2+ years on big data, on-prem or cloud data platforms
- Hadoop (HDFS) or AWS (S3)
- Python or Java; PySpark, Spark SQL or Snowpark
- Strong SQL (MySQL, SQL Server or Oracle)
- Oozie or Informatica; Git
Nice to have
- Snowflake (preferred)
- Airflow (preferred)
Technologies
- Agile
- Airflow
- AWS
- Data Pipelines
- ELT
- ETL
- Git
- Hadoop
- Java
- MySQL
- Oracle
- PySpark
- Python
- S3
- Snowflake
- Snowpark
- Spark
- SQL
- SQL Server
Highlights
Snowflake and Airflow experience are preferred but not mandatory. Applications are to be submitted via cal.lk/careers.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka