Hourly News Scraper Portal
Budget / Salary$30–250
TypeFreelance project
LocationRemote
Posted2 hours ago
I need a small application that checks a chosen info website every hour, captures any freshly posted content, and immediately publishes those findings inside a password-protected web portal. The exact data points we collect—new arrestee, charge , bond amounts, or something else—can be finalised together once development begins, but the program must recognise what is new since the previous run and avoid duplicates.
The workflow I have in mind is straightforward:
1. An automated scraper (Python with BeautifulSoup, Scrapy, or a comparable solution is fine) runs on an hourly schedule.
2. Scraped items are stored in a lightweight database so they can be compared against previous runs and displayed chronologically.
3. A simple web interface, secured by login credentials, shows the fresh entries as soon as they are gathered. Pagination, search or basic filtering would be helpful, although not essential for version 1.
4. I should be able to adjust the target URL, the scraping frequency, and, if possible, add extra news sources later without major re-coding.
Please build with clear, commented code, provide setup instructions, and include a brief README that covers how to change scrape targets and user credentials. A small demo on your server (or a recorded walkthrough) will serve as the acceptance test before hand-over of the source files.
The workflow I have in mind is straightforward:
1. An automated scraper (Python with BeautifulSoup, Scrapy, or a comparable solution is fine) runs on an hourly schedule.
2. Scraped items are stored in a lightweight database so they can be compared against previous runs and displayed chronologically.
3. A simple web interface, secured by login credentials, shows the fresh entries as soon as they are gathered. Pagination, search or basic filtering would be helpful, although not essential for version 1.
4. I should be able to adjust the target URL, the scraping frequency, and, if possible, add extra news sources later without major re-coding.
Please build with clear, commented code, provide setup instructions, and include a brief README that covers how to change scrape targets and user credentials. A small demo on your server (or a recorded walkthrough) will serve as the acceptance test before hand-over of the source files.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.