Awesome Large Language Models
📄
Papers
🧭
Topics
🔥
Trending
🗺️
Map
🏆
Leaderboards
🎓
Learn
🤖
Ask AI
⋯
More
👥
Authors
📚
Reading Packs
📊
Datasets
🛠️
Tools
📰
News
📝
Blogs
✉️
Newsletter
🎯
Research Radar
🔖
Saved
+ Add Paper
☾
☀
← authors
·
overview
Loading author…
🤖
Ask AI
Guilherme Penedo — most-cited papers & profile · Large Language Models
← authors
·
overview
Guilherme Penedo
6
papers ·
774
citations
Google Scholar ↗
Semantic Scholar ↗
OpenAlex ↗
Most-cited papers
The Fineweb Datasets: Decanting The Web For The Finest Text Data At Scale
2024 · 769 citations
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
2024 · 5 citations
Towards Best Practices for Open Datasets for LLM Training
2025
The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text
2025
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
2025
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
2023
Top co-authors
Hynek Kydlíček
· 4
Colin Raffel
· 3
Leandro Von Werra
· 3
Loubna Ben Allal
· 3
Thomas Wolf
· 3
Aviya Skowron
· 2
Sebastian Majstorovic
· 2
Shayne Longpre
· 2
Stella Biderman
· 2
Aaron Gokaslan
· 1
A. Feder Cooper
· 1
Alessandro Cappelli
· 1
Topics
Training Techniques
Fine-Tuning
Evaluation
Code
Survey Paper
Vision-Language