Data Engineer
About the role
The Data Engineer role involves building and optimizing scalable data pipelines and cloud data platforms to support real-time analytics and decision-making. Key responsibilities include developing ETL/ELT pipelines, designing medallion data layers, monitoring and troubleshooting production pipelines, delivering high-quality datasets for analytics teams, and collaborating in an Agile environment. Candidates should have experience with big data or cloud platforms, strong programming and SQL skills, and familiarity with modern data engineering tools and practices. The position is with CAL, and applications can be submitted via their careers page.
Must have
- Degree in Computer Science, IT, Big Data or a related field, or equivalent experience
- 3+ years of hands-on data engineering on big data or cloud data platforms
- Strong production experience with Snowflake (preferred), Hadoop (HDFS) or AWS (S3)
- Strong Python or Java; hands-on with PySpark, Spark SQL or Snowpark
- Advanced SQL (MySQL, SQL Server or Oracle), including query tuning and optimization
- Production experience with Airflow (preferred), Oozie or Informatica
- Proven experience implementing CDC, SCD and medallion architectures
- Track record of troubleshooting production pipelines and reducing compute and storage costs
- Git, CI/CD and code review experience
Technologies
- Agile
- Airflow
- AWS
- CI/CD
- Data Engineering
- Data Science
- ELT
- ETL
- Git
- Hadoop
- Java
- MySQL
- Oracle
- PySpark
- Python
- S3
- Snowflake
- Snowpark
- Spark
- SQL
- SQL Server
Highlights
Application is via cal.lk/careers. Snowflake and Airflow experience are preferred but not strictly required. The company is CAL. No explicit mention of remote work, location, or salary.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka