Senior Engineer – Data Engineering
About the role
The Senior Engineer – Data Engineering will design, develop, and implement enterprise-grade data engineering solutions for a global corporation in the food marketing and distribution sector. The role involves building scalable and distributed data processing applications, implementing CI/CD pipelines, and ensuring code quality and reliability. The engineer will collaborate with cross-functional teams in an Agile environment, apply DevOps principles, and contribute throughout the software development lifecycle, including development, QA, deployment, and production support. Candidates should have a Bachelor’s Degree in Computer Science or equivalent, 3–5 years of relevant experience, strong programming skills in Python, Shell scripting, and SQL, and hands-on experience with relational and NoSQL databases, distributed storage platforms, and ETL tools. Familiarity with Agile methodologies, DevOps practices, and CI/CD tools is also required.
Must have
- Bachelor’s Degree in Computer Science or an equivalent qualification, with 3–5 years of experience developing enterprise-grade data processing applications.
- Strong programming skills in Python, Shell scripting, and SQL.
- Proven experience in processing and managing large volumes of data.
- Hands-on experience with relational and NoSQL databases and distributed storage platforms such as HDFS, Amazon S3, and Redshift.
- Experience in ETL design and development using tools such as Informatica and AWS services, including AWS Data Pipeline, Glue, Lambda, EMR, Spark, and Hive.
- Familiarity with Scrum, Agile methodologies, and DevOps practices.
- Experience with code management and CI/CD tools such as GitHub, GitLab, and Jenkins.
- Ability to contribute to technical discussions, align team members on technical direction, and drive implementation.
- Strong willingness to continuously learn and develop technical skills.
- Excellent communication, collaboration, and influencing skills.
Nice to have
- Knowledge of streaming technologies such as Amazon Kinesis, Kafka, Storm, or Spark Streaming will be an added advantage.
- Experience in API development and front-end technologies such as Node.js, AngularJS, and HTML will be an added advantage.
Technologies
- Agile
- Angular
- AWS
- Bash
- CI/CD
- Data Engineering
- Data Pipelines
- DevOps
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- Kinesis
- AWS Lambda
- Node.js
- NoSQL
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL