Spaces:

UncommonCrawl
/

README

Running

App Files Files Community

README / README.md

notmeguca

Update README.md

cd56d8b verified 8 months ago

preview code

raw

history blame contribute delete

337 Bytes

metadata

title: README
emoji: 🦀
colorFrom: green
colorTo: indigo
sdk: static
pinned: false

The UncommonCrawl Project

The UncommonCrawl Project crawls select websites which block Common Crawl (CCBot) from crawling them. We provide raw WARC files containing the most important or relevant resources; no further processing is done.