Data Engineer (Databricks)
About the role
The Data Engineer (Databricks) role is responsible for supporting the migration of legacy data platforms to a unified Databricks cloud environment for a leading diversified conglomerate in Sri Lanka. The position involves designing and optimizing ETL/ELT pipelines, administering the Databricks platform, enforcing governance policies, and collaborating with cross-functional data teams. Candidates should have 2 to 5 years of experience in data engineering or related fields, with strong hands-on skills in Databricks, Apache Spark, Delta Lake, Azure Data Factory, and SQL/Python scripting. The role offers an opportunity to work in a high-performance, innovative environment and contribute to the organization's analytics modernization efforts.
Must have
- Bachelor’s degree in Computer Science, Data Engineering, Information Technology, Software Engineering, or a related discipline.
- Minimum 2 to 5 years of progressive experience in data engineering, BI architecture, or cloud data platform administration.
- Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Azure Data Factory (ADF), Azure Synapse (or SQL-based data warehouses), and SQL/Python scripting.
- Solid understanding of data pipeline orchestration, cloud security controls, access management, and data quality frameworks.
- Strong analytical and troubleshooting mindset, proactive ownership, excellent team collaboration, and effective communication skills.
Technologies
- Azure
- Azure Data Factory
- Azure Synapse
- Cloud Security
- Data Engineering
- Data Pipelines
- Data Warehousing
- Databricks
- Delta Lake
- ELT
- ETL
- Python
- RBAC
- Spark
- SQL
Highlights
This is an on-site role based in Colombo, Sri Lanka. The position is full-time and requires a minimum of 2 years of relevant experience. The company is a publicly listed conglomerate with operations across Asia.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka