Public summary
A freelance, part-time opportunity for a Senior Python Data Scraping Engineer to contribute to specialized data scraping workflows within an AI and human hybrid system. The role involves managing complex web extraction tasks, ensuring data accuracy and quality, and utilizing both internal tools and custom methods. Candidates should have over five years of experience in data engineering or web scraping, strong Python skills, expertise with dynamic content extraction, automation, and experience with cloud infrastructure and large language model frameworks. The position requires English proficiency (B2 or above) and offers flexible, estimated weekly hours and competitive hourly compensation.
Location and work setup
- Location
- Munich
- Remote status
- Remote
- German requirement signal
- No German Required Detected
- Detected job language
- English
Salary
USD 45.00 - 45.00 hour
Responsibilities
- Manage end-to-end data extraction workflows from complex and dynamic websites, ensuring completeness and accuracy. - Use internal tools and custom workflows to accelerate data collection, validation, and processing. - Handle dynamic content such as JavaScript-rendered data and adapt methods against site changes. - Enforce data quality through systematic validation and verification methods. - Scale scraping operations efficiently while monitoring failures and maintaining stability. - Collaborate indirectly with AI agents by providing domain expertise, critical thinking, and quality control.
Qualifications
- Minimum 5 years of experience in data engineering, web scraping, automation, or software development. - Strong proficiency in Python web scraping libraries such as BeautifulSoup and Selenium, including handling dynamic web content and APIs. - Experience with data cleaning, normalization, and delivering structured datasets (CSV, JSON, Google Sheets). - Proven ability to navigate anti-bot mechanisms and maintain stable scraping workflows at scale. - Familiarity with cloud infrastructure (AWS or equivalent) and containerization tools like Docker. - Hands-on experience using large language model frameworks like LangChain or OpenRouter in automation. - Bachelor's or Master's degree in Engineering, Applied Mathematics, Computer Science, or a related field is a plus. - Upper-intermediate or higher English language proficiency (B2+). - Self-directed with strong problem-solving skills and attention to detail. - GitHub portfolio is an advantage.