Senior Data Engineer
About the role
The Senior Data Engineer will lead the architecture, design, and deployment of enterprise data infrastructure, taking ownership of complex data pipelines and driving architectural decisions to ensure scalable, secure, and production-ready data ecosystems. Responsibilities include building ETL/ELT pipelines, managing big data environments, backend and API integration, workflow orchestration, deploying containerized applications, and supporting MLOps practices. The role also involves providing mentorship to junior and mid-level engineers. The position is with ORYSYS Limited and offers the opportunity to work with advanced data engineering and machine learning operations.
Must have
- Experience: Minimum 5+ years of hands-on experience in Data Engineering.
- Lead the small team and guide junior engineers.
- Best Practices need to follow on production ready setup.
- Efficient code design pattern usage.
- Multithreading knowledge.
- Expertise in git end point version handling.
- Heavily hands on experience expecting.
- Exposure to Google Cloud Platform services and architecture. (or any other vendor)
- Programming: Strong proficiency in Python. Solid experience with backend frameworks like FastAPI and Spring Boot.
- Big Data & Streaming: Extensive experience with Hadoop environments, Apache Spark, Kafka, and NiFi.
- ETL/Orchestration: Deep expertise in ETL pipeline creation, productionizing data workflows, Airflow, and dbt.
- Databases: Advanced SQL skills with deep knowledge of DB2 SQL and PostgreSQL. Capable of handling massive time-series datasets.
- Infrastructure & Security: Proficiency with Linux CLI, Docker, Kubernetes, network configuration, and OAuth2 implementation.
- MLOps: Proven knowledge and hands-on experience with MLOps principles and productionizing machine learning
Technologies
- Airflow
- CLI
- Data Engineering
- Data Pipelines
- Db2
- dbt
- Docker
- ELT
- ETL
- FastAPI
- GCP
- Git
- Hadoop
- Kafka
- Kubernetes
- Linux
- Machine Learning
- MLOps
- Multithreading
- NiFi
- OAuth
- PostgreSQL
- Python
- Spark
- Spring / Spring Boot
- SQL
- Time Series
Highlights
Applications should be sent to careers@orysys.com. The company is an equal opportunity employer. No specific location, visa, or relocation requirements are mentioned.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka