Data Engineer Intern
About the role
The Data Engineer Intern at iLabs will assist in developing, testing, and maintaining ETL data pipelines using SQL and Python, cleanse and validate datasets, integrate RESTful APIs, and prototype AI agents to automate data workflows. The role also involves conducting data analysis with pandas, engineering web scrapers, and maintaining thorough documentation and version control. Candidates should have a degree in a relevant field, strong Python and SQL skills, and a solid understanding of data engineering paradigms and web integration fundamentals. iLabs is a global software product engineering company based in Sri Lanka, serving a variety of industries and offering opportunities to work on innovative projects with a global impact.
Must have
- Possessing a degree in Computer Science, Data Science, Software Engineering, or a relevant academic discipline.
- Demonstrating strong core Python capabilities, encompassing foundational data structures, control flow mechanisms, modular functions, and robust exception handling.
- Applying hands-on expertise with pandas to perform dataset cleansing, complex transformations, aggregations, and seamless data merging.
- Leveraging solid SQL fundamentals for data retrieval, filtering, multi-table joins, and managing relational database architectures including primary and foreign key constraints.
- Understanding core data engineering paradigms, including ETL/ELT pipeline design, real-time streaming versus batch workflows, and architectural differences between relational databases and data warehouses.
- Comprehending web integration fundamentals, including RESTful API methods, standard HTTP response codes, and structured JSON payloads.
- Distinguishing clear theoretical and practical boundaries between Artificial Intelligence (AI), Machine Learning (ML), and Large Language Models (LLMs).
- Taking complete ownership of delivered code, effectively articulating logic and design decisions even when utilizing generative AI assistance tools.
- Exhibiting an eager growth mindset, collaborative spirit, and excellent professional communication skills in both written and spoken English.
Nice to have
- Demonstrating practical backend experience utilizing modern Python web frameworks such as FastAPI, Flask, or Django.
- Engineering web scrapers using BeautifulSoup, Selenium, or Playwright to systematically gather data from online sources.
- Integrating Large Language Model APIs into Python application pipelines for programmatic text processing and task automation.
- Possessing functional familiarity with intelligent agent architectures and protocols, including LangChain, LangGraph, CrewAI, or Model Context Protocol (MCP).
- Crafting intuitive graphical representations and analytical plots through libraries such as matplotlib, seaborn, or Plotly.
- Understanding enterprise data processing technologies including Apache Airflow, Spark, Kafka, or Databricks acquired through academic coursework or practical projects.
- Comprehending cloud platforms (AWS, GCP, or Azure), containerization using Docker, and fundamental Unix/Linux CLI operations.
- Showcasing an active GitHub profile or project portfolio containing original work in data engineering, web extraction, or artificial intelligence.
Technologies
- Agentic AI
- Airflow
- AWS
- Azure
- CLI
- CrewAI
- Data Engineering
- Data Pipelines
- Data Science
- Data Warehousing
- Databricks
- Django
- Docker
- E-commerce
- ELT
- ETL
- FastAPI
- Flask
- GCP
- Generative AI
- Git
- GitHub
- JSON
- Kafka
- LangChain
- LangGraph
- Linux
- LLM
- Machine Learning
- Matplotlib
- MCP
- pandas
- Parquet
- Playwright
- Plotly
- Prototyping
- Python
- REST
- Seaborn
- Selenium
- Spark
- SQL
- Unix
Highlights
The internship is based in Battaramulla with a shift from 9am to 6pm. The company culture emphasizes creativity, innovation, and global impact. Applicants should be prepared for an on-site role and demonstrate strong communication skills in English.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka