Senior/Data Engineer
About the role
The Senior/Data Engineer at iLabs will be responsible for designing, building, and maintaining scalable and reliable data pipelines for both batch and real-time workloads. The role involves developing and managing data integration, storage, and processing solutions to support analytics and business needs, ensuring data quality and performance, and building APIs and services for internal data accessibility. The engineer will also collaborate with cross-functional teams, mentor junior members, and contribute to engineering standards. The position is based on-site in Battaramulla and is part of a global software product engineering company with a strong presence in the US and Sri Lanka, serving a variety of industries and focusing on innovation and impactful solutions.
Must have
- BS/MS in Computer Science, Engineering, or a related field.
- 3 - 5 years of experience in a data engineering role.
- Strong experience with lakehouse architectures and Delta Lake.
- Hands-on experience with streaming and CDC technologies such as Kafka and Debezium.
- Proficiency with workflow orchestration tools such as Apache Airflow.
- Experience with distributed query engines such as Trino/Presto and Hive.
- Strong Python skills.
- Advanced SQL, with a strong grasp of data warehousing, relational database theory, and NoSQL databases.
- Experience building APIs with FastAPI, Django, or Flask.
- Hands-on experience with AWS.
- Comfortable working in Linux environments.
- Excellent communication, interpersonal, and organizational skills.
Nice to have
- Experience with Databricks.
- Exposure to GCP or Azure (e.g., Azure Data Factory).
- Experience with Spark or other large-scale data processing frameworks.
- Docker and Kubernetes experience.
- Knowledge of data modeling and design patterns.
- Web scraping experience (Selenium, Beautiful Soup, or similar).
- Familiarity with CI/CD and monitoring tools.
Technologies
- Airflow
- AWS
- Azure
- Azure Data Factory
- CI/CD
- Data Engineering
- Data Modeling
- Data Pipelines
- Data Warehousing
- Databricks
- Debezium
- Delta Lake
- DevOps
- Django
- Docker
- E-commerce
- FastAPI
- Flask
- GCP
- Hive
- Kafka
- Kubernetes
- Lakehouse
- Linux
- Machine Learning
- NoSQL
- Python
- Selenium
- Spark
- SQL
- Trino
Highlights
The role requires working on-site in Battaramulla with a shift from 9.00am to 6.00pm. iLabs emphasizes a culture of creativity, innovation, and global impact. The company operates in a global context with opportunities to work on ventures like Cloud of Goods and Xenia. No information on visa sponsorship or application deadline is provided.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka