Shopify Data Scraper & API
Budget / Salary₹12,500–37,500
TypeFreelance project
LocationRemote
Posted2 hours ago
I need a complete, production-ready solution that continuously harvests product data from one specific Shopify store and makes it easily accessible to me and anyone I share a login link with.
Core workflow
• All products from the store are scraped on my server. The scraper must capture title, price, stock level, colour, size, and full description.
• Data should update on a fixed schedule (cron or queue) and also refresh instantly when I press a button in the interface.
• A clean web dashboard must display the current catalogue with search / filter, plus a “Download CSV” action that exports everything.
• When I paste an individual product URL, the system should return that item’s details immediately without waiting for the next scheduled run.
External access for clients
Alongside the dashboard I want a lightweight REST or GraphQL API. My clients will call an endpoint with either no parameters (to fetch the full catalogue) or a product handle/URL (to fetch one item).
• JSON response must mirror the fields shown in the dashboard.
• Provide an option to trigger a CSV download of the entire catalogue via the API as well.
What I expect in the hand-off
1. All source code (scraper, backend, frontend, API).
2. Environment and deployment instructions that let me recreate the stack on a fresh VPS or cloud instance.
3. Inline code comments plus a short PDF/Markdown guide covering scheduler setup, credentials, and how to add rate-limit or proxy settings if the target store changes.
Python (Scrapy or BeautifulSoup), Node.js with Puppeteer, or another robust approach is fine—choose the stack you’re most efficient with as long as it is headless, reliable, and easy for me to extend later. The final build must run without a browser window and cope with typical anti-bot measures used by Shopify themes.
Once everything is in place I’ll test by sharing the login link with a few partners and calling the API from a small script; acceptance is complete when both routes deliver the correct data and the scheduled job updates automatically.Also you team shouls provide enough document and info with complete expaination so in future my team can update when require
Core workflow
• All products from the store are scraped on my server. The scraper must capture title, price, stock level, colour, size, and full description.
• Data should update on a fixed schedule (cron or queue) and also refresh instantly when I press a button in the interface.
• A clean web dashboard must display the current catalogue with search / filter, plus a “Download CSV” action that exports everything.
• When I paste an individual product URL, the system should return that item’s details immediately without waiting for the next scheduled run.
External access for clients
Alongside the dashboard I want a lightweight REST or GraphQL API. My clients will call an endpoint with either no parameters (to fetch the full catalogue) or a product handle/URL (to fetch one item).
• JSON response must mirror the fields shown in the dashboard.
• Provide an option to trigger a CSV download of the entire catalogue via the API as well.
What I expect in the hand-off
1. All source code (scraper, backend, frontend, API).
2. Environment and deployment instructions that let me recreate the stack on a fresh VPS or cloud instance.
3. Inline code comments plus a short PDF/Markdown guide covering scheduler setup, credentials, and how to add rate-limit or proxy settings if the target store changes.
Python (Scrapy or BeautifulSoup), Node.js with Puppeteer, or another robust approach is fine—choose the stack you’re most efficient with as long as it is headless, reliable, and easy for me to extend later. The final build must run without a browser window and cope with typical anti-bot measures used by Shopify themes.
Once everything is in place I’ll test by sharing the login link with a few partners and calling the API from a small script; acceptance is complete when both routes deliver the correct data and the scheduled job updates automatically.Also you team shouls provide enough document and info with complete expaination so in future my team can update when require
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.