Technical Lead - Data Engineering
About the role
Superloop is seeking a Technical Lead - Data Engineering to join their Data and AI team. The role involves developing and maintaining data pipelines, managing the data warehouse, and improving infrastructure through tooling and ETL processes. The Technical Lead will collaborate with analysts and system developers, ensure data security and compliance, and support analytical needs by providing clean, well-structured data. The position requires strong technical skills in data warehousing, ETL, dbt, Databricks or Apache Spark, AWS, Linux, containerization, SQL, and Python. Superloop is a leading Australian connectivity provider, and this role is part of their Strategy and Transformation team, which drives business value and performance.
Must have
- Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent work experience).
- 5+ years of experience as a capable Data Engineer, with a strong focus on data warehousing and ETL processes
- Proficiency with dbt and data orchestration tools.
- Proficiency in Databricks ( or open source Apache Spark) for data warehousing and data processing.
- Proficiency in AWS, Linux, Containerization and latest database trends
- Strong SQL skills for data querying, manipulation, and optimization.
- Proficiency in Python for scripting and automation of data processes.
- Experience working with large volumes of data and complex data models.
- Knowledge of data integration and orchestration techniques and tools.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
Technologies
- AWS
- Data Engineering
- Data Ingestion
- Data Pipelines
- Data Warehousing
- Databricks
- dbt
- ETL
- Linux
- Python
- Spark
- SQL
Highlights
The role offers a hybrid work arrangement (3 days in the office, 2 days from home after confirmation). Benefits include quarterly awards, milestone gifts, referral bonuses, regular team events, flexible work, and a career development program. Superloop is committed to diversity and inclusion, welcoming applicants from all backgrounds.