Data Engineer
About the role
The Data Engineer role at ORYSYS involves leading the architecture, design, and deployment of enterprise data infrastructure. The position bridges data engineering, backend services, and machine learning operations (MLOps). Key responsibilities include building scalable ETL/ELT pipelines, managing big data environments, backend development with Python FastAPI and Spring Boot, workflow orchestration with Apache Airflow and dbt, and supporting MLOps practices. Candidates should have strong experience in data engineering, Python programming, big data tools, ETL/orchestration, advanced SQL, and infrastructure security. The role also values experience with Google Cloud Platform and banking domain knowledge.
Must have
- Experience: Minimum 3+ years of hands-on experience in Data Engineering.
- Programming: Strong proficiency in Python. Solid experience with backend frameworks like FastAPI and Spring Boot.
- Big Data & Streaming: experience with Hadoop environments, Apache Spark, Kafka, and Airflow. These are must requirements.
- ETL/Orchestration: Deep expertise in ETL pipeline creation, productionizing data workflows, Airflow, and dbt (not mandatory).
- Databases: Advanced SQL skills with deep knowledge of DB2 SQL and PostgreSQL. Capable of handling massive time-series datasets. Work experience in IBM AS400 is advantageous.
- Infrastructure & Security: Proficiency with Linux CLI, Docker, Kubernetes, network configuration, and OAuth2 implementation.
- MLOps: Proven knowledge and hands-on experience with MLOps principles and productionizing machine learning workflows.
- Exposure to Google Cloud Platform (GCP) services and architecture. (or any other vendor).
- Having Banking domain experience is advantageous.
Technologies
- Airflow
- AS/400
- CLI
- Data Engineering
- Db2
- dbt
- DevOps
- Docker
- ELT
- ETL
- FastAPI
- GCP
- Hadoop
- Kafka
- Kubernetes
- Linux
- Machine Learning
- MLOps
- Model Deployment
- NiFi
- OAuth
- PostgreSQL
- Python
- Spark
- Spring / Spring Boot
- SQL
- Time Series
Highlights
Application is via email to careers@orysys.com. Experience with IBM AS400 and banking domain is advantageous but not mandatory. Equal opportunity employer. No explicit mention of remote work or location requirements.