Hacker Database Web Scraping

via Freelancer ·

Budget / SalaryHourly project
TypeFreelance project
LocationRemote
Posted2 hours ago
I need an experienced web scraping developer to extract the complete public Hacker Database from SoldierX.com.

Pages to scrape:
https://www.soldierx.com/hdb
https://www.soldierx.com/hdb?page=1
https://www.soldierx.com/hdb?page=2
https://www.soldierx.com/hdb?page=3
https://www.soldierx.com/hdb?page=4
https://www.soldierx.com/hdb?page=5
https://www.soldierx.com/hdb?page=6
https://www.soldierx.com/hdb?page=7
https://www.soldierx.com/hdb?page=8
https://www.soldierx.com/hdb?page=9
https://www.soldierx.com/hdb?page=10
https://www.soldierx.com/hdb?page=11
https://www.soldierx.com/hdb?page=12
https://www.soldierx.com/hdb?page=13
https://www.soldierx.com/hdb?page=14
https://www.soldierx.com/hdb?page=15
https://www.soldierx.com/hdb?page=16
https://www.soldierx.com/hdb?page=17
https://www.soldierx.com/hdb?page=18

Also scrape every individual profile/subpage linked from these index pages.

Required fields:
Handle/Name, Profile URL, IRL Name, Tags, Full Biography, Facts, Rumors, References, Images/Image Links, Picture Count.

Output:
Excel/CSV, fully editable.

The site may have Cloudflare/ASN restrictions, so please test access before bidding. Public data only; no login/private data required.

Important:
I will share a sample file showing the exact required format and fields. Please follow that sample exactly.

Please bid only if you can test the website and confirm you can extract the full dataset.
data processing data entry excel web scraping data mining data scraping data extraction data collection data management data annotation
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.