Website Content Scraping Needed
Budget / Salary$30–250
TypeFreelance project
LocationRemote
Posted2 hours ago
I need the full textual content of a set of websites extracted and handed back to me in a clean, machine-readable dataset. The task is limited to scraping website content (no product feeds or user information), but within that scope I want every publicly available page: headings, body copy, meta tags, image alt text—anything that helps recreate or analyse the site’s structure.
Here is what I’m expecting:
• A repeatable script or notebook (Python with BeautifulSoup, Scrapy, Selenium, or a comparable tool is fine) that I can rerun later on new URLs.
• The scraped data delivered in a single file per run—CSV, Excel, or JSON all work for me, so use whichever format your pipeline handles best; just keep it consistent.
• Respectful crawling: follow robots.txt, add delays, rotate headers or proxies if needed so the target servers are not overloaded.
• Clear documentation: what to install, how to launch the scraper, and a short note explaining each output field.
• A quick demo run on one of the target domains so I can confirm everything is captured as expected.
Let me know which libraries you plan to use, any assumptions you need to make about site layout, and your estimated turnaround time. If you have past scraping examples, feel free to reference them so I can gauge fit.
Here is what I’m expecting:
• A repeatable script or notebook (Python with BeautifulSoup, Scrapy, Selenium, or a comparable tool is fine) that I can rerun later on new URLs.
• The scraped data delivered in a single file per run—CSV, Excel, or JSON all work for me, so use whichever format your pipeline handles best; just keep it consistent.
• Respectful crawling: follow robots.txt, add delays, rotate headers or proxies if needed so the target servers are not overloaded.
• Clear documentation: what to install, how to launch the scraper, and a short note explaining each output field.
• A quick demo run on one of the target domains so I can confirm everything is captured as expected.
Let me know which libraries you plan to use, any assumptions you need to make about site layout, and your estimated turnaround time. If you have past scraping examples, feel free to reference them so I can gauge fit.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.