HA

Senior Engineer – Data Engineering

Hatchyardlinkedin.com
Nov 16, 2026, 5:08 PM13h ago
Full-timeNugegoda, Western ProvinceData engineeringSenior (3+ yrs)

About the role

The Senior Engineer – Data Engineering will design, develop, and implement enterprise-grade data engineering solutions for a global corporation in the food marketing and distribution sector. The role involves building scalable and distributed data processing applications, implementing CI/CD pipelines, and ensuring code quality and reliability. The engineer will collaborate with cross-functional teams in an Agile environment, apply DevOps principles, and contribute throughout the software development lifecycle, including development, QA, deployment, and production support. Candidates should have a Bachelor’s Degree in Computer Science or equivalent, 3–5 years of relevant experience, strong programming skills in Python, Shell scripting, and SQL, and hands-on experience with relational and NoSQL databases, distributed storage platforms, and ETL tools. Familiarity with Agile methodologies, DevOps practices, and CI/CD tools is also required.

Must have

  • Bachelor’s Degree in Computer Science or an equivalent qualification, with 3–5 years of experience developing enterprise-grade data processing applications.
  • Strong programming skills in Python, Shell scripting, and SQL.
  • Proven experience in processing and managing large volumes of data.
  • Hands-on experience with relational and NoSQL databases and distributed storage platforms such as HDFS, Amazon S3, and Redshift.
  • Experience in ETL design and development using tools such as Informatica and AWS services, including AWS Data Pipeline, Glue, Lambda, EMR, Spark, and Hive.
  • Familiarity with Scrum, Agile methodologies, and DevOps practices.
  • Experience with code management and CI/CD tools such as GitHub, GitLab, and Jenkins.
  • Ability to contribute to technical discussions, align team members on technical direction, and drive implementation.
  • Strong willingness to continuously learn and develop technical skills.
  • Excellent communication, collaboration, and influencing skills.

Nice to have

  • Knowledge of streaming technologies such as Amazon Kinesis, Kafka, Storm, or Spark Streaming will be an added advantage.
  • Experience in API development and front-end technologies such as Node.js, AngularJS, and HTML will be an added advantage.

Technologies

  • Agile
  • Angular
  • AWS
  • Bash
  • CI/CD
  • Data Engineering
  • Data Pipelines
  • DevOps
  • ETL
  • GitHub
  • GitLab
  • Hive
  • HTML
  • Jenkins
  • Kafka
  • Kinesis
  • AWS Lambda
  • Node.js
  • NoSQL
  • Python
  • Redshift
  • S3
  • Scrum
  • Spark
  • SQL