Data Engineer I
About the role
The Data Engineer I at Circles is responsible for designing, developing, and supporting scalable data platforms and pipelines that power analytics, reporting, machine learning, and business operations across multiple markets. The role involves building and optimizing batch and streaming data pipelines, maintaining cloud-native data platforms, and taking end-to-end ownership of data engineering initiatives from solution design to production support. The position requires strong collaboration with product, analytics, and engineering teams to deliver reliable data solutions and includes responsibilities such as developing data models, ETL/ELT pipelines, and monitoring platform health. The ideal candidate will have experience with modern data engineering technologies, cloud object storage, and excellent communication skills. Circles is a global technology company focused on innovative SaaS solutions for the telco industry, with a commitment to diversity and inclusion.
Must have
- 1+ years of experience in Data Engineering, or Big Data
- Strong experience designing and building scalable ETL/ELT pipelines using Python, Spark/PySpark, and SQL.
- Hands-on experience with modern data lakehouse technologies such as Apache Iceberg, Hive, Trino, Big query, Red shift, ClickHouse and Snowflake. (any one)
- Experience working with cloud object storage solutions such as Amazon S3 or S3-compatible object storage platforms.
- Strong analytical and problem-solving skills with the ability to work independently in a fast-paced environment.
- Excellent communication and stakeholder management skills, with the ability to collaborate effectively across cross-functional teams.
Nice to have
- Experience building and supporting real-time data pipelines using Apache Kafka and distributed data processing frameworks.
- Strong understanding of database technologies, including, any one RDBMS like Mysql, Oracle and MongoDB (optional), with expertise in SQL performance tuning and data optimization.
- Experience developing data ingestion frameworks and integrating data from relational and NoSQL (optional) databases using SQLAlchemy, PyMongo, and other database connectivity frameworks.
- Good to have experience deploying and managing applications on Kubernetes, with working knowledge of Docker and GitLab CI/CD pipelines.
- LLM based application using LangGraph, MLOps
- Experience monitoring, troubleshooting, and optimizing production data platforms, including root cause analysis and performance optimization.
- Good understanding of distributed systems, data architecture, data governance, and security best practices.
- Experience in the telecommunications domain and supporting multi-market data platforms is an advantage.
- Familiarity with Agile development methodologies and tools such as JIRA.
- Data Platform development, with a strong track record of delivering enterprise-scale data solutions.
Technologies
- Agile
- CI/CD
- ClickHouse
- Cloud Native
- Data Engineering
- Data Ingestion
- Data Lake
- Data Pipelines
- Data Warehousing
- DevOps
- Docker
- ELT
- ETL
- GitLab
- Hive
- Iceberg
- Jira
- Kafka
- Kubernetes
- Lakehouse
- LangGraph
- LLM
- Machine Learning
- MLOps
- MongoDB
- MySQL
- NoSQL
- Oracle
- PySpark
- Python
- RDBMS
- S3
- SaaS
- Snowflake
- Spark
- SQL
- Trino
Highlights
The role is based in Sri Lanka. Applicants must consent to Circles’ Candidate Data Protection and Privacy Policy as part of the application process. Only resumes submitted via the company's ATS will be considered; unsolicited resumes sent directly to employees or other channels will not be acknowledged.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka