Advanced Web Scraping: Historical Hackers Directory
Budget / Salary€10–50
TypeFreelance project
LocationRemote
Posted4 hours ago
As part of a university project, I require the public directory of historical notable hackers from the database at https://soldierx.com/ cybersecurity-forum, downloaded and saved. This is publicly available webdata, no login or registration is required. But the website has some security measures in place that make scraping trickier. Some high risk IP ranges are blocked, (eventually Proxy needed) and simple automation tools like HTTrack are detected, and the IP even gets banned sometimes. It requires a tool like PlayWright or similar to work. Formats are flexible as long as they are editable and not screenshots, allowing integration of text and images into the digital Project-Landcape. I need the entire information. This covers both the data of the index-pages and their specific subsections containing the detailed profile information for each individual.
All information on the following pages is required:
https://www.soldierx.com/hdb
https://www.soldierx.com/hdb?page=1
https://www.soldierx.com/hdb?page=2
https://www.soldierx.com/hdb?page=3
https://www.soldierx.com/hdb?page=4
https://www.soldierx.com/hdb?page=5
https://www.soldierx.com/hdb?page=6
https://www.soldierx.com/hdb?page=7
https://www.soldierx.com/hdb?page=8
https://www.soldierx.com/hdb?page=9
https://www.soldierx.com/hdb?page=10
https://www.soldierx.com/hdb?page=11
https://www.soldierx.com/hdb?page=12
https://www.soldierx.com/hdb?page=13
https://www.soldierx.com/hdb?page=14
https://www.soldierx.com/hdb?page=15
https://www.soldierx.com/hdb?page=16
https://www.soldierx.com/hdb?page=17
https://www.soldierx.com/hdb?page=18
-Including thir respective subpages that contain the profile information.
Complete Data-set has to be provided within 24 hours.
I only accept bids that include 2-3 lines of already scaped Sample-Data to ensure that the job gets properly done.
THE PRIMARY REQUIREMENT FOR BEEING ALLOWED TO PLACE A BIT:
>>>>!The bid amount is binding and can under no circumstances be changed afterwards!
All information on the following pages is required:
https://www.soldierx.com/hdb
https://www.soldierx.com/hdb?page=1
https://www.soldierx.com/hdb?page=2
https://www.soldierx.com/hdb?page=3
https://www.soldierx.com/hdb?page=4
https://www.soldierx.com/hdb?page=5
https://www.soldierx.com/hdb?page=6
https://www.soldierx.com/hdb?page=7
https://www.soldierx.com/hdb?page=8
https://www.soldierx.com/hdb?page=9
https://www.soldierx.com/hdb?page=10
https://www.soldierx.com/hdb?page=11
https://www.soldierx.com/hdb?page=12
https://www.soldierx.com/hdb?page=13
https://www.soldierx.com/hdb?page=14
https://www.soldierx.com/hdb?page=15
https://www.soldierx.com/hdb?page=16
https://www.soldierx.com/hdb?page=17
https://www.soldierx.com/hdb?page=18
-Including thir respective subpages that contain the profile information.
Complete Data-set has to be provided within 24 hours.
I only accept bids that include 2-3 lines of already scaped Sample-Data to ensure that the job gets properly done.
THE PRIMARY REQUIREMENT FOR BEEING ALLOWED TO PLACE A BIT:
>>>>!The bid amount is binding and can under no circumstances be changed afterwards!
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.