Senior Python Data Scraping Engineer (Freelance)

About the role

Mindrift is seeking a Senior Python Data Scraping Engineer on a freelance basis to support the Tendem project. You will design, implement, and maintain end‑to‑end web‑scraping workflows that deliver high‑quality, structured datasets for real‑world applications.

Key responsibilities

• Develop and own complete data extraction pipelines for complex, dynamic websites.
• Utilize tools such as Apify, OpenRouter, Selenium, and custom Python scripts to collect and validate data.
• Handle JavaScript‑rendered content, AJAX calls, infinite scroll, and proxy management.
• Implement validation checks, cross‑source consistency controls, and formatting standards before delivery.
• Scale scraping operations using batching, parallelization, and monitoring to ensure stability against site changes.

Required profile

• Minimum 5 years of experience in data engineering, web scraping, or software development.
• Strong problem‑solving skills with a methodical, detail‑oriented approach.
• Ability to work independently and deliver reliable results on a part‑time remote schedule.

Required skills

• Python programming
• BeautifulSoup
• Selenium (or similar browser automation)
• Apify platform
• OpenRouter
• Proxy handling
• JavaScript, AJAX, infinite scroll handling
• API integration
• Data validation and quality assurance
• Batch processing and parallelization techniques