Awesome Large Language Models
Papers
Topics
Trending
Leaderboards
Authors
Datasets
Learn
Ask AI
Map
Tools
Reading Packs
News
All sections
Browse
Papers
The full index, filterable and sortable.
Topics
The same papers grouped by subject tag.
Trending
What moved this week, and by how much.
Authors
Who publishes here, and who they publish with.
Map
The collection laid out by embedding similarity.
Compare
Leaderboards
Benchmark tables, with the paper behind each number.
Datasets
The datasets these papers train and evaluate on.
Tools
Code and libraries released alongside the papers.
Read
Learn
Ordered routes from background reading to current work.
Ask AI
Ask a question and get answers cited to these papers.
Videos
The most-watched talks and lectures in this field.
Reading Packs
Short curated sets built around one question.
Follow
News
Press and coverage tied back to the papers.
Blogs
Author and lab write-ups of their own work.
Newsletter
Email digest of what changed, on a schedule.
Research Radar
Paste an abstract, get matches across every collection.
Yours
Saved
Papers you bookmarked in this browser.
+ Add Paper
☾
☀
← authors
·
overview
Loading author…
Ask AI
Saurabh Tiwary — most-cited papers & profile · Large Language Models
← authors
·
overview
Saurabh Tiwary
5
papers ·
0
citations
Google Scholar ↗
Semantic Scholar ↗
OpenAlex ↗
Most-cited papers
Knowledge-Aware Language Model Pretraining
2020
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
2021
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
2022
Top co-authors
Xia Song
· 4
Chenyan Xiong
· 3
Paul Bennett
· 3
Payal Bajaj
· 2
and Bryan Catanzaro
· 1
Brandon Norick
· 1
Corby Rosset
· 1
Di He
· 1
Elton Zhang
· 1
George Zerveas
· 1
Guolin Ke
· 1
Jared Casper
· 1
Topics
Vision-Language
Model Architecture
RAG
Fine-Tuning
Efficiency
Training Techniques