Fineweb-2

Name: Fineweb-2
License: odc-by

Emerging

2papers using it

84,950HF downloads

837HF likes

2025first seen

🥂 FineWeb2 A sparkling update with 1000s of languages What is it? This is the second iteration of the popular 🍷 FineWeb dataset, bringing high quality pretraining data to over 1000 🗣️ languages. The 🥂 FineWeb2 dataset is fully reproducible, available under the permissive ODC-By 1.0 license and extensively validated

🤗 Hugging Face⚖ odc-by

Papers using Fineweb-2 (2)

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models2025 · 1 cites

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language2025