Awesome Large Language Models
π
Papers
π§
Topics
π₯
Trending
πΊοΈ
Map
π
Leaderboards
π
Learn
π€
Ask AI
β―
More
π₯
Authors
π
Reading Packs
π
Datasets
π οΈ
Tools
π°
News
π
Blogs
βοΈ
Newsletter
π―
Research Radar
π
Saved
+ Add Paper
βΎ
β
β all topics
overview
Pre-training
loadingβ¦
π€
Ask AI
Awesome Pre-training β curated papers, datasets & benchmarks Β· Awesome Large Language Models
β all topics
overview
Pre-training
6 papers tagged Pre-training β re-sort below
Papers
π₯ Trending (default)
π Most cited
π Newest first
π€ A β Z by title
6 papers Β· trending (default)
numbers = π₯ heat
DanQing: An Up-to-Date Large-Scale Chinese Vision-Language Pre-training Dataset
(2026)
Hengyu Shen et al.
1.94
Control LLM: Controlled Evolution for Intelligence Retention in LLM
(2025)
Haichao Wei et al.
1.28
un^2CLIP: Improving CLIP's Visual Detail Capturing Ability via Inverting unCLIP
(2025)
Yinqi Li et al.
1.28
Scaling Agents via Continual Pre-training
(2025)
Liangcai Su et al.
1.28
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks
(2023)
Haiyang Xu et al.
β
Scaling (Down) CLIP: A Comprehensive Analysis of Data, Architecture, and Training Strategies
(2024)
Zichao Li et al.
β