OL

Senior Data Engineer

ORYSYS Limitedtopjobs.lk
Sep 21, 20265w ago
Colombo 3, Sri LankaData engineeringSenior (5+ yrs)

About the role

The Senior Data Engineer will lead the architecture, design, and deployment of enterprise data infrastructure. Responsibilities include building and managing complex ETL/ELT pipelines, designing big data ecosystems, leading backend and API integration, orchestrating workflows, deploying containerized applications, and supporting MLOps practices. The role also involves mentoring junior engineers and ensuring production-ready, scalable, and secure data solutions. The position requires strong hands-on experience in data engineering, backend development, and cloud platforms.

Must have

  • Experience: Minimum 5+ years of hands-on experience in Data Engineering.
  • Lead the small team and guide junior engineers.
  • Best Practices need to follow on production ready setup .
  • Efficient code design pattern usage.
  • Multithreading knowledge.
  • Expertise in git end point version handling.
  • Heavily hands on experience expecting.
  • Exposure to Google Cloud Platform services and architecture. (or any other vendor)
  • Programming: Strong proficiency in Python. Solid experience with backend frameworks like FastAPI and Spring Boot.
  • Big Data & Streaming: Extensive experience with Hadoop environments, Apache Spark, Kafka, and NiFi.
  • ETL/Orchestration: Deep expertise in ETL pipeline creation, productionizing data workflows, Airflow, and dbt.
  • Databases: Advanced SQL skills with deep knowledge of DB2 SQL and PostgreSQL. Capable of handling massive time-series datasets.
  • Infrastructure & Security: Proficiency with Linux CLI, Docker, Kubernetes, network configuration, and OAuth2 implementation.
  • MLOps: Proven knowledge and hands-on experience with MLOps principles and productionizing machine learning models.

Technologies

  • Airflow
  • CLI
  • Data Engineering
  • Db2
  • dbt
  • Docker
  • ELT
  • ETL
  • FastAPI
  • GCP
  • Git
  • Hadoop
  • Kafka
  • Kubernetes
  • Linux
  • Machine Learning
  • MLOps
  • Multithreading
  • NiFi
  • OAuth
  • PostgreSQL
  • Python
  • Spark
  • Spring / Spring Boot
  • SQL
  • Time Series

Highlights

Applications should be sent to careers@orysys.com. The role involves leading a small team and providing mentorship to junior and mid-level engineers.