Senior Data Engineer
About the role
The Senior Data Engineer will design and develop enterprise-grade data engineering solutions to support large-scale business operations and analytics. Responsibilities include building and maintaining distributed data processing applications, developing scalable ETL and data integration pipelines, optimizing data platforms for performance and reliability, and implementing cloud-based data engineering solutions. The role also involves collaborating with cross-functional teams, adhering to CI/CD practices, and applying DevOps principles throughout the software lifecycle. The position is offered by InTalent Asia for a client in the Information Technology industry, based in Sri Lanka, and is a contract role.
Must have
- Bachelor's Degree in Computer Science or an equivalent discipline.
- 3–5 years of experience developing enterprise-grade data processing applications.
- Strong programming background with hands-on expertise in Python, Shell Scripting, and SQL.
- Experience processing and managing large-scale datasets within enterprise environments.
- Hands-on experience with relational databases, NoSQL databases, and distributed storage platforms.
- Experience working with technologies such as HDFS, Amazon S3, and Redshift.
- Strong expertise in ETL design, development, and data integration.
- Experience with ETL and cloud data tools such as Informatica, AWS Data Pipelines, Glue, Lambda, EMR, Spark, and Hive.
- Experience working in Scrum Agile delivery environments.
- Strong understanding of DevOps practices and modern software delivery methodologies.
- Hands-on experience with source code management and CI/CD tools including GitHub, GitLab, and Jenkins.
- Strong communication, collaboration, and stakeholder management skills.
- Ability to influence technical discussions and contribute to engineering strategy and implementation approaches.
- Passion for learning new technologies and continuously expanding technical expertise.
Nice to have
- Experience working with data streaming technologies such as Kafka, Kinesis, Storm, or Spark Streaming will be an added advantage.
- Exposure to API development and front-end technologies such as NodeJS, AngularJS, and HTML will be beneficial.
Technologies
- Agile
- Angular
- AWS
- Bash
- CI/CD
- Data Engineering
- Data Ingestion
- Data Pipelines
- DevOps
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- Kinesis
- AWS Lambda
- Node.js
- NoSQL
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL
Highlights
The position is based in Sri Lanka and is offered as a contract. The employer is InTalent Asia, acting as a recruitment partner for their client. Candidates should be ready to work in Agile/Scrum environments.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka