Senior Data Engineer
About the role
The Senior Data Engineer role is responsible for developing data ingestion pipelines from various sources, building PySpark/Spark transformations, and implementing data processing patterns on Azure Databricks. The position involves optimizing Spark jobs, writing automated tests, integrating with Azure services, and supporting production monitoring. Candidates should have significant experience in data engineering, particularly with PySpark/Spark, Azure Databricks, Delta Lake, and related technologies. The role is based in Colombo with a hybrid working method and offers a competitive salary paid in USD. Interested applicants are encouraged to send their updated resume to the provided email address or contact number.
Must have
- Overall 7+ years of experience and 5+ years data engineering with strong production PySpark/Spark experience.
- Strong Azure Databricks, Delta Lake, SQL and ADLS Gen2.
- REST/API ingestion and database integration experience.
- Incremental/CDC processing and schema-evolution experience.
- Good data-quality/testing practices and Git/CI/CD.
- Experience handling large, messy enterprise datasets
Technologies
- Azure
- CI/CD
- Data Engineering
- Databricks
- Delta Lake
- Git
- MDM
- PySpark
- REST
- Spark
- SQL
Highlights
Salary is paid in USD. The role is hybrid and based in Colombo. Applications should be sent to sruthi.baskaran@cusolid.com or via phone at 0740428589.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka