Common Crawl Foundation

@CommonCrawl

Common Crawl is a non-profit foundation dedicated to the Open Web.

San Francisco, CA

Common Crawl Foundation
@CommonCrawl
Sep 21
Information Stewardship Forum 2026: Creating Community and Purpose Around US Government Information A report from the inaugural Information Stewardship Forum, a three-day convening hosted by the Internet Archive in San Francisco on March 18–20, 2026, that brought together 120
1
Common Crawl Foundation
@CommonCrawl
Sep 19
September 2026 Crawl Archive Now Available We are pleased to announce the release of the September 202 6 crawl archive, consisting of 2.17 billion pages (or 361.4 TiB of uncompressed content.) 📷
1
Common Crawl Foundation
@CommonCrawl
Sep 16
Getting Started with Common Crawl Data on Hugging Face We made parts of our crawl archive available experimentally on a Hugging Face Storage Bucket. This blog post explains how to use the data on Hugging Face, with tools and examples on which you can build.
1
Common Crawl Foundation
@CommonCrawl
Sep 15
CommonsDB, ISCC, Spaghetti, and Meatballs Notes from the CommonsDB final conference in Alicante: a registry of 6.5 million open works keyed on ISCC, and the EUIPO's push for federated copyright infrastructure.
1
Common Crawl Foundation
@CommonCrawl
Sep 15
Bodhium Labs: From web pages to a question corpus FineQuestions draws on 110 snapshots of FineWeb, the filtered English-language corpus derived from Common Crawl, spanning 2013–2025. Extraction yielded roughly 13.4 billion raw questions filling 22 TB. Normalization and
2