Scrape 10M+ E-commerce Products
Budget / SalaryC$30–250
TypeFreelance project
LocationRemote
Posted2 hours ago
I need a reliable, large-scale scraping routine that can pull more than ten million product records from the main online marketplaces. For every item I only require three fields—product name, full description and current price—and I want the finished data delivered in well-structured CSV files that I can import straight into my analytics pipeline.
Please build the solution so it can:
• Run headless and distributed, handling rotating proxies, captchas and throttling without breaking.
• Resume gracefully if an interruption occurs.
• Export clean CSV output (one row per SKU, UTF-8, comma-delimited).
A short sample on a few thousand items will serve as acceptance testing before we run the full harvest. Once that passes I’ll green-light the full scrape.
Please build the solution so it can:
• Run headless and distributed, handling rotating proxies, captchas and throttling without breaking.
• Resume gracefully if an interruption occurs.
• Export clean CSV output (one row per SKU, UTF-8, comma-delimited).
A short sample on a few thousand items will serve as acceptance testing before we run the full harvest. Once that passes I’ll green-light the full scrape.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.