Web Scraper & Search Dashboard

via Freelancer ·

Budget / Salary₹12,500–37,500
TypeFreelance project
LocationRemote
Posted1 hour ago
I need a complete, production-ready tool that will automatically pull both text and images from one specific, publicly accessible website and then let me explore that content through a fast, user-friendly search dashboard.

Here is what I expect:

• Scraping engine – written in Python (Scrapy or BeautifulSoup are fine) that traverses every relevant page, captures the required text and image assets, and stores them with the correct relationships.

• Storage & indexing – a lightweight database or index (SQLite, PostgreSQL, or an Elasticsearch/Lucene-based option) that supports full-text queries and image asset references so searches return results in milliseconds.

• Dashboard – a simple web interface (React, Vue, or plain Flask/Django templates) with:
 – global search bar with instant suggestions
 – filters for key fields you extract
 – image thumbnails alongside textual data
 – pagination or infinite scroll for long result sets

• Scheduler/CLI – a way to trigger re-scrapes manually or on a cron so the data stays fresh.

Acceptance criteria
1. Running one command populates the database with the latest site data (text + images saved or hot-linked).
2. Searching a keyword in the dashboard returns accurate, relevant records in under two seconds.
3. Clear README explains setup, configuration, and how to add new fields if the site layout changes.

Because the target site requires no login, captchas, or session handling, the job is mostly about solid scraping logic, data modeling, and a clean search UI. Let me know which stack you prefer and any similar projects you have shipped.
javascript python web scraping django sqlite scrapy beautifulsoup database management
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.