college-scraper / scraper

Commit History

chore: major architecture cleanup. removed state filtering, deleted redundant AICTE/UGC/INC scrapers, and updated documentation
6a2e373

sharanyaswarup commited on

feat: Add DGT (NCVT) and URISE UP ITI scrapers & update Master DB merger
c3af398

sharanyaswarup commited on

Auto-save master database directly to HuggingFace dataset upon creation
651fd6a

sharanyaswarup commited on

Speed up master database creation
3f2b35a

sharanyaswarup commited on

Add Master Database Merger button to UI and fix NAAC column mapping
8ff3430

sharanyaswarup commited on

fix: retrieve institution names and districts from AICTE secondary API
e1ce8aa

sharanyaswarup commited on

Fixed INC missing directory issue and added Orissa/Uttaranchal aliases
424b3c7

sharanyaswarup commited on

Added INC scraper and duplicate filtering across all scrapers
2f9ae6a

sharanyaswarup commited on

Added browser headers to bypass AICTE WAF on Hugging Face
b777663

sharanyaswarup commited on

Fixed generator object error in AICTE fetcher
90895bb

sharanyaswarup commited on

Refactored AICTE downloader to stream logs to prevent HF Spaces timeouts
1f05812

sharanyaswarup commited on

Added AICTE scraping pipeline with dynamic year extraction
c7a817f

sharanyaswarup commited on

Fixed Playwright sandbox freezing issue in Docker
5eff2c4

sharanyaswarup commited on

Added NAAC scraping pipeline and multi-sheet support
6f8d589

sharanyaswarup commited on

Added UGC scraping pipeline, fuzzy matching, and generic UI updates
b0cc807

sharanyaswarup commited on

Removed summary block from logs
8b944c5

sharanyaswarup commited on

Initial commit: AISHE College Data Scraper v1.0
72acc1c

sharanyaswarup commited on