Spaces:

UncommonCrawl
/

README

Running

App Files Files Community

README / README.md

notmeguca's picture

Update README.md

cd56d8b verified 8 months ago

|

history blame contribute delete

337 Bytes

	---
	title: README
	emoji: 🦀
	colorFrom: green
	colorTo: indigo
	sdk: static
	pinned: false
	---

	# The UncommonCrawl Project

	The UncommonCrawl Project crawls select websites which block Common Crawl (`CCBot`) from crawling them.
	We provide raw WARC files containing the most important or relevant resources; no further processing is done.