Key papers

• ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance (2025)
  Wissam Antoun et al.
  3.81
• DanQing: An Up-to-Date Large-Scale Chinese Vision-Language Pre-training Dataset (2026)
  Hengyu Shen et al.
  1.94
• Data Darwinism Part I: Unlocking the Value of Scientific Data for Pre-training (2026)
  Yiwei Qin et al.
  1.94
• Rethinking UMM Visual Generation: Masked Modeling for Efficient Image-Only Pre-training (2026)
  Peng Sun et al.
  1.94
• Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music (2026)
  Sreyan Ghosh et al.
  1.94
• Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale (2026)
  Ang Li et al.
  1.94
• MinerU2.5-Pro: Pushing the Limits of Data-Centric Document Parsing at Scale (2026)
  Bin Wang et al.
  1.83
• Diffutron: A Masked Diffusion Language Model for Turkish Language (2026)
  Şuayp Talha Kocabay et al.
  1.78
• Data Science and Technology Towards AGI Part I: Tiered Data Management (2026)
  Yudong Wang et al.
  1.72
• Learning to Detect Language Model Training Data via Active Reconstruction (2026)
  Junjie Oscar Yin et al.
  1.72
• Centurio: On Drivers of Multilingual Ability of Large Vision-Language Model (2025)
  Gregor Geigle et al.
  1.28
• Wan: Open and Advanced Large-Scale Video Generative Models (2025)
  WanTeam et al.
  1.28
• Prot2Token: A Unified Framework for Protein Modeling via Next-Token Prediction (2025)
  Mahdi Pourmirzaei et al.
  1.28
• SAIL-VL2 Technical Report (2025)
  Weijie Yin et al.
  1.28
• Apriel-1.5-15b-Thinker (2025)
  Shruthan Radhakrishna et al.
  1.28
• Detecting Data Contamination from Reinforcement Learning Post-training for Large Language Models (2025)
  Yongding Tao et al.
  1.28
• Scaling Laws for Deepfake Detection (2025)
  Wenhao Wang et al.
  1.28
• Towards Mixed-Modal Retrieval for Universal Retrieval-Augmented Generation (2025)
  Chenghao Zhang et al.
  1.28
• From Code Foundation Models to Agents and Applications: A Practical Guide to Code Intelligence (2025)
  Jian Yang et al.
  1.28
• Scaling Laws for Code: Every Programming Language Matters (2025)
  Jian Yang et al.
  1.28
• Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone (2025)
  Jiacheng Ye et al.
  1.28
• Cross-Lingual Supervision improves Large Language Models Pre-training (2023)
  Andrea Schioppa et al.
  —
• MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training (2023)
  Yizhi Li et al.
  —
• Scaling Relationship on Learning Mathematical Reasoning with Large Language Models (2023)
  Zheng Yuan et al.
  —
• Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support (2024)
  Xiaojun Wu et al.
  —
• Weaver: Foundation Models for Creative Writing (2024)
  Tiannan Wang et al.
  —
• CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay (2024)
  Natasha Butt et al.
  —
• Qwen2-Audio Technical Report (2024)
  Yunfei Chu et al.
  —
• PiTe: Pixel-Temporal Alignment for Large Video-Language Model (2024)
  Yang Liu et al.
  —
• Hyper-Connections (2024)
  Defa Zhu et al.
  —
• How to Synthesize Text Data without Model Collapse? (2024)
  Xuekai Zhu et al.
  —