AI Web Scraping & CSV Merge

I already have a spreadsheet of dynamic URLs, each containing searchable databases of mainly business listings (people records matter too, but the business layer comes first). From every URL I need the script to pull three fields—Name, Contact information and Address—and funnel everything into one clean, well-structured master CSV.

Because the links rely on search parameters rather than static pages, the scraper has to cope with pagination, filters and the occasional redirect. If you normally lean on Claude for pattern recognition or tools such as Ultimate Web Scraper, Playwright, Beautiful Soup or similar for automation, that’s exactly the kind of workflow I’m hoping for. Whatever stack you choose, please make it fully headless so I can run future batches without a browser window.

Deliverables
• Reusable script (Python preferred, but open)
• Consolidated CSV with the three requested columns, deduplicated and UTF-8 encoded
• Brief “how-to-run” read-me so I can rerun the scraper on fresh URL lists

Acceptance criteria
• 100 % of the supplied URLs processed
• No blank rows; each row contains a Name, a Contact field and an Address or the record is logged as skipped with a reason
• Final CSV imports into Excel or Google Sheets without additional cleanup

If this sounds straightforward for your toolset, let’s talk timetable and any rate-limiting precautions you recommend before we kick off.

NO SPAM

Message for a sample URL where we are asking you to do a free trial; it is only 165 listings. PM me for the URL

We will pay a fixed rate for each scrape depending on complexity so price given is indicative