Senior Data Engineer
About the role
The Senior Data Engineer will be responsible for designing and developing enterprise-grade data engineering solutions to support large-scale business operations and analytics. The role involves building and maintaining distributed, highly available data processing applications, developing scalable ETL and data integration pipelines, and implementing cloud-based data engineering solutions. The candidate will work closely with cross-functional teams, adhere to CI/CD practices, and contribute to technical discussions and engineering best practices. The position is offered on a renewable contract basis, initially for 6 months, with the possibility of extension based on performance. The role is based in Colombo 03 and follows a hybrid working model within the software industry.
Must have
- Bachelor's Degree in Computer Science or an equivalent discipline.
- 3–5 years of experience developing enterprise-grade data processing applications.
- Strong programming background with hands-on expertise in Python, Shell Scripting, and SQL.
- Experience processing and managing large-scale datasets within enterprise environments.
- Hands-on experience with relational databases, NoSQL databases, and distributed storage platforms.
- Experience working with technologies such as HDFS, Amazon S3, and Redshift.
- Strong expertise in ETL design, development, and data integration.
- Experience with ETL and cloud data tools such as Informatica, AWS Data Pipelines, Glue, Lambda, EMR, Spark, and Hive.
- Experience working in Scrum Agile delivery environments.
- Strong understanding of DevOps practices and modern software delivery methodologies.
- Hands-on experience with source code management and CI/CD tools including GitHub, GitLab, and Jenkins.
- Strong communication, collaboration, and stakeholder management skills.
- Ability to influence technical discussions and contribute to engineering strategy and implementation approaches.
- Passion for learning new technologies and continuously expanding technical expertise.
Nice to have
- Experience working with data streaming technologies such as Kafka, Kinesis, Storm, or Spark Streaming will be an added advantage.
- Exposure to API development and front-end technologies such as NodeJS, AngularJS, and HTML will be beneficial.
Technologies
- Agile
- Angular
- AWS
- Bash
- CI/CD
- Data Engineering
- Data Ingestion
- Data Pipelines
- DevOps
- ETL
- GitHub
- GitLab
- Hive
- HTML
- Jenkins
- Kafka
- Kinesis
- AWS Lambda
- Node.js
- NoSQL
- Python
- Redshift
- S3
- Scrum
- Spark
- SQL
Highlights
The position is a renewable contract, starting with 6 months and potentially extending to a 1-year renewable contract based on performance. The role is hybrid, located in Colombo 03, with standard Monday to Friday working hours. Applications can be submitted via email to recruitment7@intalent.asia. The employer is InTalent Asia, recruiting on behalf of a client.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka