Public summary
A part-time remote freelance opportunity for a Senior Python Data Scraping Engineer to work on complex web data extraction workflows using various tools and AI integration. Ideal for experienced professionals skilled in Python web scraping, data processing, and automation, collaborating with AI agents to deliver accurate structured data. Compensation up to $37 per hour depending on contribution level.
Salary
USD 37.00 - 37.00 hour
Responsibilities
Manage end-to-end data extraction from complex, dynamic websites ensuring accuracy and completeness. Utilize provided tools like Apify and OpenRouter alongside custom methods to optimize scraping workflows. Handle JavaScript-rendered and interactive content and adapt to site changes. Enforce data quality via validation, consistency checks, and formatting standards. Scale operations efficiently through batching or parallelization and maintain stable performance despite minor structural changes on source websites.
Qualifications
Minimum of 3 years experience in data engineering, web scraping, automation, or software development. Strong proficiency in Python web scraping tools such as BeautifulSoup and Selenium, including handling dynamic content and APIs using proxies. Skilled in extracting from complex web structures and in data cleaning, normalization, and producing structured datasets (CSV, JSON, Google Sheets). Experience with Large Language Models and AI frameworks to enhance automation is preferred. Upper-intermediate English (B2) or higher required. Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related fields is a plus. Self-motivated with strong attention to detail and problem-solving skills. Providing a GitHub portfolio is advantageous.