Senior Web Scraping Expert for Large-Scale B2B Directory Extraction (Germany & Austria) -- 2
Budget / Salary₹12,500–37,500
TypeFreelance project
LocationRemote
Posted2 hours ago
We are seeking a highly experienced web scraping professional for a long-term collaboration involving large-scale B2B data extraction from major public industry directories in Germany and Austria.
This is not a one-time scraping task. We are building a structured, scalable data acquisition system and require a technically strong partner capable of handling full extraction, enrichment, and monthly incremental automation.
---
### Phase 1 – Initial Full Extraction (Per Source)
We will provide 1–2 directory sources as a pilot.
For each source, the freelancer must:
• Extract the complete company inventory
• Capture required fields:
* Email address (highest priority)
* Company name
* Street address
* Postal code
* City
• If available: Telephone, Fax, Website, Industry
• Deliver structured Excel output
For records without email but with website:
• Crawl company website
• Scan Impressum / Contact / Legal Notice pages
• Extract and validate business email addresses
• Enrich dataset accordingly
This phase must be priced as a **fixed one-time cost per source**, covering full extraction, enrichment, formatting, and delivery.
---
### Phase 2 – Monthly Incremental Extraction
After completing the full inventory for each source:
• Build a system to detect and extract only newly added listings each month
• Apply the same enrichment logic
• Deliver monthly Excel file
• Monitor structural changes in source directories
This phase must be priced as a **fixed monthly rate per source**, ensuring predictable ongoing costs.
---
### Important Context
We already maintain a very large internal B2B database (~5 million records).
Scalability, structured architecture, and long-term reliability are essential.
We are looking for a professional partner — not a short-term task worker.
---
### Proposal Requirements
Please include:
1. Experience with large directory scraping projects
2. Your technical approach to enrichment via website crawling
3. Fixed price per source for full extraction
4. Monthly price per source for incremental updates
5. Estimated timeline for one full directory extraction
We are building a long-term partnership with consistent monthly work — a stable win-win collaboration.
---
If you'd like, I can also give you a more “strict screening” version that filters out low-quality applicants immediately.
This is not a one-time scraping task. We are building a structured, scalable data acquisition system and require a technically strong partner capable of handling full extraction, enrichment, and monthly incremental automation.
---
### Phase 1 – Initial Full Extraction (Per Source)
We will provide 1–2 directory sources as a pilot.
For each source, the freelancer must:
• Extract the complete company inventory
• Capture required fields:
* Email address (highest priority)
* Company name
* Street address
* Postal code
* City
• If available: Telephone, Fax, Website, Industry
• Deliver structured Excel output
For records without email but with website:
• Crawl company website
• Scan Impressum / Contact / Legal Notice pages
• Extract and validate business email addresses
• Enrich dataset accordingly
This phase must be priced as a **fixed one-time cost per source**, covering full extraction, enrichment, formatting, and delivery.
---
### Phase 2 – Monthly Incremental Extraction
After completing the full inventory for each source:
• Build a system to detect and extract only newly added listings each month
• Apply the same enrichment logic
• Deliver monthly Excel file
• Monitor structural changes in source directories
This phase must be priced as a **fixed monthly rate per source**, ensuring predictable ongoing costs.
---
### Important Context
We already maintain a very large internal B2B database (~5 million records).
Scalability, structured architecture, and long-term reliability are essential.
We are looking for a professional partner — not a short-term task worker.
---
### Proposal Requirements
Please include:
1. Experience with large directory scraping projects
2. Your technical approach to enrichment via website crawling
3. Fixed price per source for full extraction
4. Monthly price per source for incremental updates
5. Estimated timeline for one full directory extraction
We are building a long-term partnership with consistent monthly work — a stable win-win collaboration.
---
If you'd like, I can also give you a more “strict screening” version that filters out low-quality applicants immediately.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.