Common Crawl Foundation

commoncrawl's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

malteos 

published a dataset 25 minutes ago

commoncrawl/commonlid-results

Preview • Updated 1 day ago • 2

malteos 

updated a Space about 3 hours ago

Running

Agents

CommonLID Leaderboard

🌍

malteos 

updated a dataset 1 day ago

commoncrawl/commonlid-results

Preview • Updated 1 day ago • 2

malteos 

in commoncrawl/commonlid-results 1 day ago

Refresh results from refactor

#1 opened 1 day ago by

malteos

malteos 

published a Space 1 day ago

Running

Agents

CommonLID Leaderboard

🌍

malteos 

updated a bucket 6 days ago

commoncrawl/commoncrawl

119 TB

malteos 

updated a bucket 9 days ago

commoncrawl/test-bucket

117 MB

lfoppiano 

updated a dataset 10 days ago

commoncrawl/statistics

Viewer • Updated 10 days ago • 626k • 424 • 26

malteos 

published a bucket 13 days ago

commoncrawl/commoncrawl

119 TB

lfoppiano 

authored 2 papers 22 days ago

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing

Paper • 2512.11192 • Published Dec 12, 2025 • 1

CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data

Paper • 2601.18026 • Published Jan 25

tvaughan 

updated a dataset about 1 month ago

commoncrawl/citations

Viewer • Updated Apr 2 • 9.18k • 68 • 2

tvaughan 

updated a dataset about 2 months ago

commoncrawl/statistics

Viewer • Updated 10 days ago • 626k • 424 • 26

greglindahl 

published a dataset 3 months ago

commoncrawl/host-index-testing-v2

Preview • Updated Nov 10, 2025 • 1.65k

malteos 

updated a Space 3 months ago

Running

9

cc-citations

📜

9

Scientific articles using or citing Common Crawl data

pjox 

published a dataset 3 months ago

commoncrawl/CommonLID

Viewer • Updated Feb 10 • 373k • 229 • 52

pjox 

updated a dataset 3 months ago

commoncrawl/CommonLID

Viewer • Updated Feb 10 • 373k • 229 • 52

pjox 

authored a paper 3 months ago

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing

Paper • 2512.11192 • Published Dec 12, 2025 • 1

catherinearnett 

authored 2 papers 6 months ago

Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training

Paper • 2506.01732 • Published Jun 2, 2025 • 6

Explaining and Mitigating Crosslingual Tokenizer Inequities

Paper • 2510.21909 • Published Oct 24, 2025