Senior Data Engineer
About the role
The Senior Data Engineer will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations and analytics. Key responsibilities include building and maintaining distributed data processing applications, developing scalable ETL and data integration pipelines, optimizing data platforms for performance and reliability, and implementing cloud-based data engineering solutions. The role also involves collaborating with cross-functional teams, adhering to CI/CD practices, and supporting troubleshooting and performance optimization of production data systems. The position is offered on a renewable contract basis, starting with an initial 6-month contract, and is based in Colombo 03 with a hybrid working arrangement. Applicants should have a Bachelor's Degree in Computer Science or a related field and 3–5 years of experience in developing enterprise-grade data processing applications, along with strong programming skills in Python, Shell Scripting, and SQL.
Must have
- Bachelor's Degree in Computer Science or an equivalent discipline.
- 3–5 years of experience developing enterprise-grade data processing applications.
- Strong programming background with hands-on expertise in Python, Shell Scripting, and SQL.
- Experience processing and managing large-scale datasets within enterprise environments.
- Hands-on experience with relational databases, NoSQL databases, and distributed storage platforms.
- Experience working with technologies such as HDFS, Amazon S3, and Redshift.
- Strong expertise in ETL design, development, and data integration.
- Experience with ETL and cloud data tools such as Informatica, AWS Data Pipelines, Glue, Lambda, EMR, Spark, and Hive.
- Experience working in Scrum Agile delivery environments.
- Strong understanding of DevOps practices and modern software delivery methodologies.
- Hands-on experience with source code management and CI/CD tools including GitHub, GitLab, and Jenkins.
- Strong communication, collaboration, and stakeholder management skills.
- Ability to influence technical discussions and contribute to engineering strategy and implementation approaches.
- Passion for learning new technologies and continuously expanding technical expertise.
Nice to have
- Experience working with data streaming technologies such as Kafka, Kinesis, Storm, or Spark Streaming will be an added advantage.
- Exposure to API development and front-end technologies such as NodeJS, AngularJS, and HTML will be beneficial.
Technologies
- Agile
- Angular
- AWS
- Bash
- CI/CD
- Data Engineering
- Data Ingestion
- Data Pipelines
- DevOps
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- Kinesis
- AWS Lambda
- Node.js
- NoSQL
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL
Highlights
The role is based in Colombo 03 with a hybrid working arrangement. The initial contract is for 6 months, with the possibility of extension to a 1-year renewable contract based on performance. Working hours are Monday to Friday, following local standard working hours. Applications can be submitted via email to recruitment7@intalent.asia.
Also posted as
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka