README.md

---
title: README
emoji: 🦀
colorFrom: green
colorTo: indigo
sdk: static
pinned: false
---

# The UncommonCrawl Project

The UncommonCrawl Project crawls select websites which block Common Crawl (`CCBot`) from crawling them.
We provide raw WARC files containing the most important or relevant resources; no further processing is done.