Python Google SERP URL Scraper

via Freelancer ·

Budget / SalaryA$10–30
TypeFreelance project
LocationRemote
Posted2 hours ago
I need a compact Python script that automatically pulls every organic result URL that appears on the first five pages of Google for any keyword I feed it. The script should accept a list of search terms (from a text file or command-line argument is fine), perform the searches, and collect only the result links—no ads, no featured snippets, no map listings.

Key points
• Pages to cover: page 1 through page 5 for each query
• Output: a neatly formatted Excel workbook (.xlsx) with one sheet per keyword or, if simpler, a single sheet that lists keyword, position, page number, and URL
• Language: Python 3.x using common libraries such as requests/BeautifulSoup or Selenium if you prefer a headless browser approach. Feel free to combine with pandas / openpyxl for the Excel export.
• The code should respect reasonable delays and user-agent rotation so that it runs reliably without triggering captchas.

Deliverable
1. Well-commented .py file(s)
2. README explaining setup, required packages, and how to run the scraper
3. Sample Excel file generated from a test keyword list so I can verify the format

I’ll consider the task complete once the script runs on my machine, produces the expected Excel output, and consistently captures every organic URL from pages 1-5 for a handful of sample searches without errors.
javascript python excel web scraping beautifulsoup data analysis selenium pandas
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.