Common Crawl

Common Crawl is a dataset that contains a vast collection of web pages and is used to evaluate the performance of language models on natural language tasks.

Papers using Common Crawl (6)

Understanding Data Temporality Impact on Large Language Models Pre-training2026Training Language Models via Neural Cellular Automata2026FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language2025Wasm: A Pipeline for Constructing Structured Arabic Interleaved Multimodal Corpora2025TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining2025UnifiedCrawl: Aggregated Common Crawl for Affordable Adaptation of LLMs on Low-Resource Languages2024 · 1 cites