Automated Supplier Price Scraper
Budget / Salary$30–250
TypeFreelance project
LocationRemote
Posted1 hour ago
I want to stop checking supplier portals one item at a time and instead trigger a script that pulls every SKU, full description and up-to-date price from the catalogues at https://www.mercante.com.br/, https://www.idbatacadistas.com.br/ and https://www.bartofil.com.br/.
The data must land in a clean, well-structured CSV because that is the format I feed into our internal quotation workflow and the AI tools that follow. I will run the extraction once a week, so the solution should be easy to schedule (cron job, GitHub Actions, Cloud Function or a comparable option you prefer).
Please include a brief but detailed project proposal outlining:
• the language and libraries you plan to use (Python + BeautifulSoup/Scrapy, Node + Puppeteer, etc.)
• how you will deal with authentication, pagination and potential anti-bot measures on the three sites
• the structure of the final CSV (mandatory columns: SKU/code, description, unit price, packaging info, date captured)
• how I will configure new suppliers or fields later without touching the core code
Deliverables will be:
1. Fully documented source code for the scraper.
2. One sample CSV containing a complete export from each site.
3. A simple runbook or README that shows me how to launch the weekly job on my own server.
If you can also expose the same data through an API endpoint, mention it as an optional add-on—I may extend the workflow in the future.
Looking forward to reviewing your approach.
The data must land in a clean, well-structured CSV because that is the format I feed into our internal quotation workflow and the AI tools that follow. I will run the extraction once a week, so the solution should be easy to schedule (cron job, GitHub Actions, Cloud Function or a comparable option you prefer).
Please include a brief but detailed project proposal outlining:
• the language and libraries you plan to use (Python + BeautifulSoup/Scrapy, Node + Puppeteer, etc.)
• how you will deal with authentication, pagination and potential anti-bot measures on the three sites
• the structure of the final CSV (mandatory columns: SKU/code, description, unit price, packaging info, date captured)
• how I will configure new suppliers or fields later without touching the core code
Deliverables will be:
1. Fully documented source code for the scraper.
2. One sample CSV containing a complete export from each site.
3. A simple runbook or README that shows me how to launch the weekly job on my own server.
If you can also expose the same data through an API endpoint, mention it as an optional add-on—I may extend the workflow in the future.
Looking forward to reviewing your approach.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.