Marketplace Scraper: Python-based Data and Image Collector

Python Developer Needed: Marketplace Data Collection & Image Scraping Tool

Project Overview

I need a Python based tool that can collect publicly available marketplace listings and their associated images whenever needed.

The tool should be reusable, scalable, and allow me to run new collection jobs without modifying the code.

Requirements

• Collect Listing ID, Title, Description, Category, Price, Location, Date, Phone Number, and Image URLs.

• Download all listing images and organize them by Listing ID.

• Export data to CSV or JSON.

• Detect and prevent duplicate listings.

• Validate downloaded images and retry failed downloads.

• Include checkpointing so interrupted jobs can resume.

• Support concurrent downloading for better performance.

• Include configurable filters such as number of listings, category, location, and other available parameters.

• Provide clear logs showing successful and failed records.

Deliverables

• Complete Python source code.

• `requirements.txt`.

• Simple `README.md`.

• Reusable command line tool that I can run whenever needed.

• Clean folder structure for listings, images, logs, and checkpoints.