Senior Data Engineer
About the role
The Senior Data Engineer will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations and analytics. The role involves building and maintaining distributed, highly available data processing applications, developing scalable ETL and data integration pipelines, and ensuring data platforms are optimized for performance and reliability. The candidate will work with modern cloud-based technologies, adhere to CI/CD practices, and collaborate with cross-functional teams in an Agile environment. The position is offered by InTalent Asia for a client in the Information Technology industry, based in Sri Lanka, and is a contract role. Applicants are encouraged to apply or share their CVs via the provided email address.
Must have
- Bachelor's Degree in Computer Science or an equivalent discipline.
- 3–5 years of experience developing enterprise-grade data processing applications.
- Strong programming background with hands-on expertise in Python, Shell Scripting, and SQL.
- Experience processing and managing large-scale datasets within enterprise environments.
- Hands-on experience with relational databases, NoSQL databases, and distributed storage platforms.
- Experience working with technologies such as HDFS, Amazon S3, and Redshift.
- Strong expertise in ETL design, development, and data integration.
- Experience with ETL and cloud data tools such as Informatica, AWS Data Pipelines, Glue, Lambda, EMR, Spark, and Hive.
- Experience working in Scrum Agile delivery environments.
- Strong understanding of DevOps practices and modern software delivery methodologies.
- Hands-on experience with source code management and CI/CD tools including GitHub, GitLab, and Jenkins.
- Strong communication, collaboration, and stakeholder management skills.
- Ability to influence technical discussions and contribute to engineering strategy and implementation approaches.
- Passion for learning new technologies and continuously expanding technical expertise.
Nice to have
- Experience working with data streaming technologies such as Kafka, Kinesis, Storm, or Spark Streaming will be an added advantage.
- Exposure to API development and front-end technologies such as NodeJS, AngularJS, and HTML will be beneficial.
Technologies
- Agile
- Angular
- AWS
- Bash
- CI/CD
- Data Engineering
- Data Ingestion
- Data Pipelines
- DevOps
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- Kinesis
- AWS Lambda
- Node.js
- NoSQL
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL
Highlights
Applications should be sent to recruitment13@intalent.asia. The role is based in Sri Lanka and is a contract position. Experience with data streaming technologies and front-end technologies is considered advantageous but not mandatory.
Also posted as
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka