Resource / Free Datasets

Common Crawl

A public web crawl corpus and index suited to retrieval, data engineering and research use.

Free and open source

The data is publicly downloadable; dataset terms, robots and downstream license requirements must be observed.

27 / 30

Strong Candidate · Maintenance risk 4/5

Last verified: 2026-08-28. A free tier is not a permanent commitment; re-check the official conditions before use.