Senior Data Engineer
About the role
The Senior Data Engineer will lead the architecture, design, and deployment of enterprise data infrastructure, focusing on building and maintaining complex data pipelines and ensuring scalable, secure, and production-ready data ecosystems. The role involves architecting and building ETL/ELT pipelines, managing big data environments with open-source tools, leading backend development, orchestrating workflows, deploying containerized applications, and supporting MLOps practices. The position also includes providing technical guidance and mentorship to junior and mid-level engineers. The company is seeking candidates with significant hands-on experience in data engineering and leadership, with strong technical skills across a range of modern data and backend technologies. The role is onsite.
Must have
- Minimum 5+ years of hands-on experience in Data Engineering
- Experience leading a small team and guiding junior engineers
- Strong Python skills and solid experience with FastAPI and Spring Boot
- Extensive experience with Hadoop, Apache Spark, Kafka and NiFi
- Deep expertise in ETL pipeline creation, productionising data workflows, Airflow and dbt
- Advanced SQL skills with deep knowledge of DB2 SQL and PostgreSQL, and the ability to handle massive time-series datasets
- Proficiency in Linux CLI, Docker, Kubernetes, network configuration and OAuth2 implementation
- Hands-on experience with MLOps principles and productionising machine learning
- Exposure to Google Cloud Platform (or any other cloud vendor)
- Good knowledge of multithreading, efficient code design patterns, Git version handling and production-ready best practices
Technologies
- Airflow
- CLI
- Data Engineering
- Data Pipelines
- Db2
- dbt
- Docker
- ELT
- ETL
- FastAPI
- GCP
- Git
- Hadoop
- Kafka
- Kubernetes
- Linux
- Machine Learning
- MLOps
- Model Deployment
- Multithreading
- NiFi
- OAuth
- PostgreSQL
- Python
- Spark
- Spring / Spring Boot
- SQL
- Time Series
Highlights
This is an onsite position. Interested candidates should send their resume to keshawa.g@jithpl.com.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka