University Program Data Scraper
Budget / Salary€30–250
TypeFreelance project
LocationRemote
Posted1 hour ago
I need a reliable scraper that can automatically collect up-to-date course details from a list of university program pages and export them in a clean, structured format (CSV or JSON is fine).
Scope
• Target data: course description, course schedule, and course prerequisites only—no faculty info or admission requirements.
• Update cycle: the dataset must refresh right before every new intake period (e.g., each semester or trimester), so the script should be easy for me to rerun or schedule.
• Sources: I will supply the university URLs; you handle respectful crawling, pagination, and any anti-bot measures.
• Output: a consolidated file plus the reusable scraping script (Python with BeautifulSoup/Scrapy or similar). Include brief setup instructions.
Acceptance
• All requested fields populated for each course.
• No duplicate rows; consistent field names.
• Script runs on a standard desktop environment without paid APIs.
If you’ve tackled higher-ed sites before, mention it—otherwise just outline your approach, estimated turnaround, and any libraries you prefer.
Scope
• Target data: course description, course schedule, and course prerequisites only—no faculty info or admission requirements.
• Update cycle: the dataset must refresh right before every new intake period (e.g., each semester or trimester), so the script should be easy for me to rerun or schedule.
• Sources: I will supply the university URLs; you handle respectful crawling, pagination, and any anti-bot measures.
• Output: a consolidated file plus the reusable scraping script (Python with BeautifulSoup/Scrapy or similar). Include brief setup instructions.
Acceptance
• All requested fields populated for each course.
• No duplicate rows; consistent field names.
• Script runs on a standard desktop environment without paid APIs.
If you’ve tackled higher-ed sites before, mention it—otherwise just outline your approach, estimated turnaround, and any libraries you prefer.
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.