Data Engineer
About the role
The Engineer – Data Engineering role involves designing, developing, and maintaining scalable enterprise data solutions and cloud-based data-processing applications. The position requires building reliable data pipelines, integrating multiple source systems, processing large volumes of data, and supporting solutions throughout the software development lifecycle. Candidates should have strong programming skills, hands-on cloud experience, and the ability to work effectively in Agile and DevOps environments. The company, InTalent Asia, is recruiting for a client in the software industry based in Sri Lanka. Applications can be submitted via LinkedIn Easy Apply or by emailing recruitment14@intalent.asia.
Must have
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or an equivalent field.
- Minimum 1 to 2 years of experience developing enterprise-grade data-processing applications.
- Strong programming skills in Python, Shell scripting, and SQL.
- Hands-on experience processing large volumes of data.
- Experience designing and developing ETL or ELT data pipelines.
- Practical experience with relational databases, NoSQL databases, and distributed storage engines.
- Hands-on experience with Google Cloud Platform.
- Experience with GCP services such as BigQuery, Dataflow, Dataproc, Datastream, Pub/Sub, Cloud Functions, Cloud Run, and Cloud Composer.
- Familiarity with ETL and orchestration tools such as Airflow.
- Good understanding of distributed systems, scalable architectures, and cloud-based data processing.
- Experience working within Scrum and Agile delivery environments.
- Familiarity with DevOps practices and software-development lifecycle processes.
- Experience with source-control and CI/CD tools such as GitHub, GitLab, and Jenkins.
- Good knowledge of software-engineering standards, testing practices, and code-quality principles.
- Strong analytical, troubleshooting, and problem-solving skills.
- Strong written and verbal communication skills.
- Ability to communicate technical ideas clearly and influence implementation decisions.
- Ability to work collaboratively within cross-functional technical teams.
- Proactive, adaptable, and committed to continuous learning and professional development.
- Strong interest in building and maintaining reliable, high-performance data solutions.
Nice to have
- Exposure to AWS data services such as Glue, Lambda, EMR, Spark, Hive, or Data Pipeline will be an advantage.
- Experience working with streaming technologies such as Kafka, Pub/Sub, Storm, or Spark Streaming will be an advantage.
- Exposure to application-monitoring tools such as Datadog or an equivalent platform will be an advantage.
- Understanding of data warehousing, data marts, data lakes, or data-mesh concepts will be preferred.
Technologies
- Agile
- Airflow
- AWS
- Bash
- BigQuery
- CI/CD
- Cloud Native
- Data Engineering
- Data Lake
- Data Pipelines
- Data Warehousing
- Datadog
- DevOps
- ELT
- ETL
- GCP
- GitHub
- GitLab
- Hive
- Jenkins
- Kafka
- AWS Lambda
- NoSQL
- Python
- Scrum
- Spark
- SQL
Highlights
Applications are accepted via LinkedIn Easy Apply or by emailing recruitment14@intalent.asia. The role is based in Sri Lanka and is a contract position. Exposure to AWS data services, streaming technologies, and application-monitoring tools is considered advantageous but not mandatory.