Senior Data Engineer
About the role
qlub is seeking a Senior Data Engineer to take ownership of their data platform, which supports internal reporting, merchant analytics, and AI-assisted tools. The role is hands-on, focusing on building and maintaining data pipelines, ensuring data reliability, and setting engineering standards for the team. Responsibilities include managing data ingestion, modeling with dbt, optimizing BigQuery, serving analytics from OLAP stores, maintaining GCP infrastructure, ensuring reliability with Airflow, and mentoring other engineers. The ideal candidate will have significant experience in production data or backend engineering, strong Python and SQL skills, and expertise with tools like dbt, Airflow, BigQuery, and GCP. qlub is a rapidly growing fintech in the restaurant technology space, offering opportunities to work on impactful products in a fast-paced environment.
Must have
- 5+ years in data or backend engineering, most of it on production systems.
- Strong Python, with years of writing and debugging production pipelines and services.
- Advanced SQL: window functions, complex transformations, and knowing why a query is slow.
- 2+ years of production dbt experience, including incremental models, macros, tests and docs.
- Experience running production Airflow DAGs, including backfills, monitoring and troubleshooting when things break.
- Strong BigQuery skills: modelling, partitioning, clustering, and query and cost tuning.
- Good knowledge of GCP, including Cloud Storage, IAM and general cloud data infrastructure.
- Solid PostgreSQL experience: indexing, query performance and incremental extraction.
- Experience with stream or distributed processing, such as Apache Flink or similar.
- Comfortable working on a Linux VM: Bash, cron, Docker, reading logs, SSH and basic networking.
- Strong engineering practice with Git, CI/CD, tests and code review, writing code other people can maintain.
Nice to have
- Experience with ClickHouse or production OLAP: tuning, materialized views and cluster operations.
- Experience with managed ETL/ELT platforms such as Airbyte or Fivetran.
- Experience with Datastream for CDC and database replication.
- Experience with Kafka and Debezium for event streaming and change data capture.
- Experience with Kubernetes and Terraform.
- Experience with BI tools such as Tableau or Power BI, and a feel for what makes dashboards slow.
- Experience with LLM APIs, RAG and agent frameworks.
- Experience with data observability tools such as Soda, Great Expectations or Monte Carlo.
- Experience with AWS (EC2, S3, RDS).
- A CS or engineering degree, though a strong track record matters more.
Technologies
- Airbyte
- Airflow
- AWS
- Bash
- BigQuery
- CI/CD
- ClickHouse
- dbt
- Debezium
- Docker
- EC2
- ELT
- ETL
- Fintech
- Fivetran
- Flink
- GCP
- Git
- IAM
- Kafka
- Kubernetes
- Linux
- LLM
- Observability
- PostgreSQL
- Power BI
- Python
- RAG
- RDS
- S3
- SaaS
- SQL
- SSH
- Tableau
- Terraform
Highlights
The company is backed by major investors including Mastercard and has raised $72M. The team is scaling rapidly and offers real ownership and the chance to impact millions of users globally. Application instructions are to apply now if interested.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka