Dashboard With Web Scraping Integration

I want to extend my current website with an internal dashboard that automatically pulls fresh text and images from a specific external site and lets me curate that material before it goes live. The key goal is streamlined content management: as soon as new articles or media appear on the source site, the scraper should capture them, store them in my database, and surface them inside a clean, password-protected dashboard where I can edit, approve, or delete each item.

My stack is flexible, but the scraper must be reliable—think Python (BeautifulSoup, Scrapy, or Selenium) or a comparable Node.js setup if you prefer. Whatever you choose, please include:

• A scheduler so I can set scrape frequency without touching code.
• Image handling that preserves original quality and names files consistently.
• Duplicate-detection logic so the same story never appears twice.
• A simple status flag in the UI (new, published, archived) and bulk actions for efficiency.

Once an item is approved, your code should slot it into the existing content structure on my site with all links, alt tags, and formatting intact. Responsive design and compatibility with the current CSS are a must; I’ll share the repo and staging URL after kickoff.

Acceptance will be based on:
1. End-to-end demonstration on my staging server.
2. Clear, commented source code plus a concise README explaining setup, environment variables, and cron/job scheduling.
3. No scraping interruptions or broken image links during a 48-hour test window.

If you have questions about the target site’s structure or need API keys, just let me know and I’ll provide them right away.