Key papers

• Sci-CoE: Co-evolving Scientific Reasoning LLMs via Geometric Consensus with Sparse Supervision (2026)
  Xiaohan He et al.
  1.94
• LM-Lexicon: Improving Definition Modeling via Harmonizing Semantic Experts (2026)
  Yang Liu et al.
  1.94
• Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interaction (2026)
  Zhuofeng Li et al.
  1.94
• MISA: Mixture of Indexer Sparse Attention for Long-Context LLM Inference (2026)
  Ruijie Zhou et al.
  1.94
• DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices (2026)
  Chenyang Song et al.
  1.94
• Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs (2026)
  Kareem Elozeiri et al.
  1.94
• Small Vision-Language Models are Smart Compressors for Long Video Understanding (2026)
  Junjie Fei et al.
  1.83
• GeoMotionGPT: Geometry-Aligned Motion Understanding with Large Language Models (2026)
  Zhankai Ye et al.
  1.67
• Graph-Aware Isomorphic Attention for Adaptive Dynamics in Transformers (2025)
  Markus J. Buehler
  1.28
• EfficientLLM: Efficiency in Large Language Models (2025)
  Zhengqing Yuan et al.
  1.28
• Towards eliciting latent knowledge from LLMs with mechanistic interpretability (2025)
  Bartosz Cywiński et al.
  1.28
• QwenLong-CPRS: Towards infty-LLMs with Dynamic Context Optimization (2025)
  Weizhou Shen et al.
  1.28
• LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning (2025)
  Zihang Liu et al.
  1.28
• Kinetics: Rethinking Test-Time Scaling Laws (2025)
  Ranajoy Sadhukhan et al.
  1.28
• Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning (2025)
  Lijie Yang et al.
  1.28
• SAIL-VL2 Technical Report (2025)
  Weijie Yin et al.
  1.28
• GRPO-MA: Multi-Answer Generation in GRPO for Stable and Efficient Chain-of-Thought Training (2025)
  Hongcheng Wang et al.
  1.28
• RewardMap: Tackling Sparse Rewards in Fine-grained Visual Reasoning via Multi-Stage Reinforcement Learning (2025)
  Sicheng Feng et al.
  1.28
• Rewiring Experts on the Fly:Continuous Rerouting for Better Online Adaptation in Mixture-of-Expert models (2025)
  Guinan Su et al.
  1.28
• Unveiling Intrinsic Dimension of Texts: from Academic Abstract to Creative Story (2025)
  Vladislav Pedashenko et al.
  1.28
• Understanding and Harnessing Sparsity in Unified Multimodal Models (2025)
  Shwai He et al.
  1.28
• From Sparse to Soft Mixtures of Experts (2023)
  Joan Puigcerver et al.
  —
• Memory Augmented Language Models through Mixture of Word Experts (2023)
  Cicero Nogueira dos Santos et al.
  —
• SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation (2024)
  Teng Hu et al.
  —
• Differential Transformer (2024)
  Tianzhu Ye et al.
  —
• Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models (2024)
  Javier Ferrando et al.
  —