Public summary
A technology company is seeking a highly skilled freelance Python Data Scraping Engineer to work remotely on specialized data scraping workflows within a hybrid AI and human system. The role involves end-to-end data extraction, using tools such as Apify and OpenRouter, handling dynamic web content, validating data quality, and scaling scraping operations. Candidates should have at least 3 years of relevant experience, strong Python scraping skills, knowledge of handling complex web structures, and English proficiency at B2 level or above. Compensation is up to $37 per hour depending on contribution level.
Salary
USD 37.00 - 37.00 hour
Responsibilities
Manage complete data extraction workflows across complex and dynamic websites ensuring accuracy and reliability. Utilize internal tools and custom methods to accelerate data collection and validation. Adapt approaches to handle JavaScript-rendered and interactive content. Enforce data quality through thorough validation and consistency checks. Scale operations efficiently with batching and parallelization while maintaining stability against site changes.
Qualifications
Minimum of 3 years experience in data engineering, web scraping, automation, or software development. Proficient in Python-based web scraping frameworks such as BeautifulSoup and Selenium, including handling dynamic content and APIs via proxies. Demonstrated ability to extract data from complex and inconsistent web structures. Experience with data cleaning, normalization, and delivering structured datasets in formats like CSV, JSON, or Google Sheets. Familiarity with LLMs and AI tools to enhance automation. Strong attention to detail, self-directed work ethic, and troubleshooting capability. Upper-intermediate (B2) or higher English proficiency. Bachelor's or Master's degree in a relevant technical field is a plus. Having a GitHub profile is advantageous.