Scrape AI Tool Directories

via Freelancer ·

Budget / Salary₹600–1,500
TypeFreelance project
LocationRemote
Posted3 hours ago
I need a complete scrape of the AI-tool directories at https://nextool.ai/ (roughly 10 000 entries) and https://theresanaiforthat.com/ (around 52 000 entries). The final file should list every tool found on those sites with the following columns:

• Tool name
• Tool URL (link to the listing page)
• Logo image link (direct, not a base64 string)
• Price (headline figure shown, e.g. “$19/mo”, “Free”)
• Price details (full text that explains tiers, free-trial notes, etc.)
• Features (bullet points or comma-separated as they appear)
• Tags
• categories
• Sub category
• Short description (directory snippet)
• Full description (the expanded text on the tool’s detail page)

You’re free to choose the most convenient output format—CSV or Excel is fine so long as the encoding is clean and ready for import.

Quality matters more than speed: missing rows, broken links, or truncated text will be rejected. Please crawl responsibly so the source sites remain unaffected, and send me a small sample first so we can confirm the structure before you run the full scrape.

When you deliver, include:
1. The final dataset.
2. The script or notebook you used (Python, Node, or similar) so I can rerun it later if the directories update.

Let me know an estimated turnaround time and any clarification you need before starting.
php python data processing data entry excel web scraping data extraction data analysis data collection data management
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.