Python Developer for Automated SEO Site Audit & Competitor Scraper

Our manual SEO audit and competitor research workflows are taking too long to scale. I need a Python developer with practical SEO knowledge to build an automated script that audits our target websites and flags critical on-page issues in minutes instead of hours.

The Problem to Solve:
We need to automatically crawl a list of URLs (both our site and competitors'), extract key on-page SEO data, identify technical errors, and output an easy-to-read action report.

Key Deliverables:
Automated Crawler: A Python script (using Requests, BeautifulSoup, or Scrapy) that crawls given domains or sitemaps without getting blocked.
On-Page Audit Extraction: Pull and flag missing or duplicate title tags, meta descriptions, H1s, broken links (404s), and slow-loading pages.
Competitor Keyword & Content Check: Extract top-used keywords and word counts from competitor URLs for side-by-side comparison.
Clean Reporting: Export all findings into a structured Excel/CSV file with a summary tab highlighting high-priority fixes.

Requirements:
Strong experience with Python web scraping, rate-limiting, and handling dynamic pages.
Practical understanding of technical SEO (crawling, status codes, metadata, sitemaps).
Clean, documented code with instructions so I can run it locally on my machine.

To apply, please briefly mention a similar SEO tool, scraper, or data automation script you have built in the past.