Senior Data Engineer
About the role
The Senior Data Engineer will be responsible for designing and implementing scalable enterprise data architectures, including data warehouses, data lakes, and lakehouse solutions. The role involves developing and maintaining robust ETL and ELT pipelines, integrating data from various sources such as ERP systems and IoT platforms, and building cloud-based data solutions using Microsoft Azure technologies. The candidate will also lead data modelling, establish data governance standards, optimize database performance, and support analytics teams. The position is based in Colombo - 03 and is offered by InTalent Asia for their client in the IT industry.
Must have
- Bachelor's degree in Information Technology, Computer Science, Data Engineering, or a related field.
- Minimum 3 to 5 years of experience in software engineering, data engineering, data architecture, or related technical roles.
- Strong experience designing and implementing enterprise data platforms.
- Hands-on experience with Microsoft Azure Data Platform technologies.
- Strong knowledge of Microsoft Fabric, Azure Synapse, Azure Data Lake, Azure Data Factory, and Azure Databricks.
- Advanced experience with PySpark, SQL, Microsoft SQL Server, SSIS, and SSAS.
- Strong understanding of data warehouse, data lake, lakehouse, and multi-layer data architecture concepts.
- Experience integrating data from ERP systems such as SAP and other enterprise applications.
- Good knowledge of data governance, data quality, metadata management, and security practices.
- Experience with CI/CD pipelines, DevOps, and automated deployment processes.
- Familiarity with Power BI, Azure Analysis Services, and enterprise reporting solutions.
- Strong SQL performance-tuning, troubleshooting, and problem-solving skills.
- Excellent communication, stakeholder-management, leadership, and mentoring abilities.
- Ability to work independently and lead complex data-engineering initiatives.
- Strong analytical mindset with the ability to translate business requirements into scalable technical solutions.
Nice to have
- Experience with real-time data, IoT platforms, Azure Event Hubs, or Event Grid will be an advantage.
- Knowledge of C#, .NET, JavaScript, Angular, or React will be an added advantage.
Technologies
- Accessibility
- Angular
- Anomaly Detection
- Azure
- Azure Data Factory
- Azure Synapse
- CI/CD
- C#
- Data Engineering
- Data Ingestion
- Data Lake
- Data Modeling
- Data Pipelines
- Data Warehousing
- Databricks
- Delta Lake
- DevOps
- .NET
- ELT
- ERP
- ETL
- Event-Driven Architecture
- JavaScript
- Lakehouse
- Metadata Management
- Microsoft Fabric
- Power BI
- PySpark
- React
- SAP
- SQL
- SQL Server
- SSIS
Highlights
The role is located in Colombo - 03 and is a full-time position. The employer is InTalent Asia, a recruitment partner in Sri Lanka. The listing encourages candidates to apply directly for this exclusive opportunity.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka