Open web crawl dataPublic data
Common Crawl Open Web Crawl Repository
Common Crawl provides raw public web crawl data for discovery research, web measurement and content analysis.
Coverage: Coverage depends on the source's documented geographic and time scope · Provider-described dataset or API records available at the indicated geography and time scope.
Large-scale public web crawl corpusPublic access is described, but any registration, account and downstream hosting costs should be checked.
Reviewed 2026-10-09Coverage and caveats →