Consultant/Senior Consultant - Databricks
About the role
Deloitte Sri Lanka is seeking talented and motivated professionals to join their Technology & Transformation team as Consultant or Senior Consultant - Databricks. The role involves designing, developing, and implementing scalable data pipelines and engineering solutions using Databricks, Apache Spark, Python, and SQL. Responsibilities include building data processing workflows, maintaining modern Lakehouse solutions, supporting migration to cloud-based architectures, and collaborating with cross-functional teams. Candidates are expected to have strong experience in data engineering, cloud technologies, and Databricks, with the ability to lead, mentor, and support junior team members.
Must have
- Bachelor’s or Master’s degree in Computer Science, Data & AI, Software Engineering, Data Engineering, or a related field
- Relevant Databricks certifications, including Databricks Certified Data Engineer Associate, will be considered an added advantage
- Consultant: 4 - 6 years of relevant experience in data engineering and cloud technologies
- Senior Consultant: 6 - 8 years of relevant experience in data engineering and cloud technologies
- Hands-on experience with Databricks and Apache Spark
- Strong programming skills in Python and SQL, including PySpark and Spark SQL
- Experience with Delta Lake, data pipelines, ETL/ELT processes, and modern data architectures
- Experience working with at least one major cloud platform: Microsoft Azure, AWS, or Google Cloud
- Hands-on experience in dimensional modelling, data warehousing, and designing scalable data models for analytics and reporting solutions
- Familiarity with data quality, performance optimisation, and data governance practices
- Strong analytical, problem-solving, communication, and stakeholder management skills
- Ability to work collaboratively in a team environment and manage multiple priorities effectively
- Experience leading technical workstreams, managing delivery teams, and driving end-to-end solution delivery
- Ability to engage with stakeholders, translate business requirements into technical designs, and provide technical guidance to junior team members
- Hands-on experience with Databricks Unity Catalog, Databricks Workflows/Jobs, and Git-based development practices, including Azure DevOps or similar CI/CD tools
Technologies
- AWS
- Azure
- Azure DevOps
- CI/CD
- Data Engineering
- Data Pipelines
- Data Warehousing
- Databricks
- Delta Lake
- DevOps
- Dimensional Modeling
- ELT
- ETL
- GCP
- Git
- Lakehouse
- PySpark
- Python
- Spark
- SQL
- Unity
Highlights
The position is based at 100, Braybrooke Place, Colombo 02. Application is via the Deloitte website. Relevant Databricks certifications, such as Databricks Certified Data Engineer Associate, are considered an advantage. The role distinguishes between Consultant (4-6 years experience) and Senior Consultant (6-8 years experience).