Python Social Media Scraper

via Freelancer ·

Budget / Salary$10–30
TypeFreelance project
LocationRemote
Posted3 hours ago
I need a lightweight Python script that can automatically collect user-profile information from public social-media posts. My immediate goal is to feed a list of post URLs or user handles into the script and receive a clean, structured dataset (CSV or JSON) that contains the core profile fields—username, display name, bio, follower/following counts, and any other non-private details that are easily exposed on the page.

I haven’t locked myself to a single platform, so feel free to design the solution around the APIs or HTML structures of Twitter, Facebook, Instagram, or a combination that you think will hold up over time. If official endpoints are rate-limited or incomplete, please outline any headless-browser or request-based fallback you plan to use, along with how you will stay within each site’s terms of service.

Essential deliverables
• Well-commented Python code (ideally 3.10+), organised in reusable functions or a small module.
• A requirements.txt or Pipfile so I can recreate the environment.
• A short README explaining setup, configuration (API keys, cookies, etc.) and how to run a sample scrape.
• One example output file showing the captured profile data.

I’m happy to review iterative milestones as you nail down login flows, pagination, or anti-bot challenges, so please note in your proposal any libraries—BeautifulSoup, Selenium, Playwright, Tweepy, Facebook Graph API, etc.—you expect to leverage and roughly how long you’ll need for a first working draft.
php javascript python software architecture api beautifulsoup selenium data collection
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.