Data Engineer - Python
About the role
The Data Engineer - Python role at Asiawise Lanka Pvt Ltd involves designing, developing, and maintaining Python scripts for web scraping and data collection from target websites. Responsibilities include extracting relevant product data, implementing scraping solutions using libraries such as BeautifulSoup, Scrapy, Selenium, or Playwright, storing and managing extracted data in structured formats, creating dashboards or reports, monitoring website structure changes, and ensuring compliance with legal and ethical guidelines. The position requires a bachelor's degree in Computer Science, Engineering, or a related field, at least 2 years of proven work experience in a similar role, proficiency in Python with a focus on data scraping and automation, experience with web scraping frameworks, APIs, authentication, AI agents, and data storage systems, as well as the ability to write clean, scalable code.
Must have
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 2 years Proven work experience in similar role.
- Proficiency in Python with a focus on data scraping and automation.
- Strong experience with web scraping frameworks (e.g., Scrapy, BeautifulSoup, Selenium).
- Experience working with APIs and handling authentication (e.g., OAuth, tokens).
- Hands-on experience designing and implementing AI agents or autonomous systems using Python and related frameworks.
- Knowledge of data storage systems like MySQL, PostgreSQL / MongoDB.
- Ability to write clean, scalable, and well-documented code.
- Basic understanding of SEO and product ranking mechanisms is a plus.
Nice to have
- Experience with e-commerce platforms like Amazon, eBay, or Shopify.
Technologies
- Agentic AI
- Authentication
- E-commerce
- MongoDB
- MySQL
- OAuth
- Playwright
- PostgreSQL
- Python
- Selenium
- SEO
- Shopify
Highlights
The role is fully remote. Competitive salary is negotiable based on experience and qualifications. Applications should be submitted via email to hire@asiawise-lanka.com, with the applied position mentioned in the subject line.
Jobs across Sri Lanka, watched for you.Colombo, Sri Lanka