Key papers

• SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model (2025)
  Loubna Ben Allal et al.
  6.58
• news-crawler-LM: A Small Long-Context Model For High-Quality News Crawling (2026)
  Pascal Stolzenburg et al.
  6.50
• Domyn-Small: A European 10B Reasoning Language Model (2026)
  Simone Angarano et al.
  5.01
• QUASAR: Quantum Assembly Code Generation Using Tool-Augmented LLMs via Agentic RL (2025)
  Cong Yu et al.
  3.10
• BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models (2025)
  Xu Huang et al.
  2.87
• Web-Shepherd: Advancing PRMs for Reinforcing Web Agents (2025)
  Hyungjoo Chae et al.
  2.82
• CausalMix: Data Mixture as Causal Inference for Language Model Training (2026)
  Zinan Tang et al.
  2.00
• PraMem: Practice-derived Experiential Memory for Long-horizon Behavior Prediction (2026)
  Zhuoqun Li et al.
  2.00
• Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning (2026)
  Wenzheng Zeng et al.
  2.00
• Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling (2026)
  Xiang Hu et al.
  2.00
• EpiCaR: Knowing What You Don't Know Matters for Better Reasoning in LLMs (2026)
  Jewon Yeom et al.
  1.94
• dVoting: Fast Voting for dLLMs (2026)
  Sicheng Feng et al.
  1.94
• Calibrate-Then-Act: Cost-Aware Exploration in LLM Agents (2026)
  Wenxuan Ding et al.
  1.94
• Learning to Commit: Generating Organic Pull Requests via Online Repository Memory (2026)
  Mo Li et al.
  1.94
• Scratchpad Patching: Decoupling Compute from Patch Size in Byte-Level Language Models (2026)
  Lin Zheng et al.
  1.94
• Code-Guided Reasoning for Small Language Models: Evaluating Executable MCQA Scaffolds (2026)
  Prateek Biswas et al.
  1.89
• MoEITS: A Green AI approach for simplifying MoE-LLMs (2026)
  Luis Balderas et al.
  1.83
• Recursive Language Models Meet Uncertainty: The Surprising Effectiveness of Self-Reflective Program Search for Long Context (2026)
  Keivan Alizadeh et al.
  1.78
• Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Acts (2026)
  Chen Yang et al.
  1.72
• Small is Beautiful: A Practical and Efficient Log Parsing Framework (2026)
  Minxing Wang et al.
  1.67
• EnvX: Agentize Everything with Agentic AI (2025)
  Linyao Chen et al.
  1.44
• NEFMind: Parameter-Efficient Fine-Tuning of Open-Source LLMs for Telecom APIs Automation (2025)
  Zainab Khan et al.
  1.39
• InferLog: Accelerating LLM Inference for Online Log Parsing via ICL-oriented Prefix Caching (2025)
  Yilun Wang and Pengfei Chen and Haiyu Huang and Zilong He and Gou Tan and Chuanfu Zhang and Jingkai He and Zibin Zheng
  1.33
• PROMPTEVALS: A Dataset of Assertions and Guardrails for Custom Production Large Language Model Pipelines (2025)
  Reya Vir et al.
  1.28
• FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language (2025)
  Guilherme Penedo et al.
  1.28
• Technical Report: Full-Stack Fine-Tuning for the Q Programming Language (2025)
  Brendan R. Hogan et al.
  1.28
• Fast-dLLM v2: Efficient Block-Diffusion LLM (2025)
  Chengyue Wu et al.
  1.28
• Rethinking Optimal Verification Granularity for Compute-Efficient Test-Time Scaling (2025)
  Hao Mark Chen et al.
  1.22
• Learning to Contextualize Web Pages for Enhanced Decision Making by LLM Agents (2025)
  Dongjun Lee et al.
  1.11
• FinerWeb-10BT: Refining Web Data with LLM-Based Line-Level Filtering (2025)
  Erik Henriksson et al.
  1.00
• ComplexFuncBench: Exploring Multi-Step and Constrained Function Calling under Long-Context Scenario (2025)
  Lucen Zhong et al.
  1.00
• ELIT: Emory Language and Information Toolkit (2021)
  Han He and Liyan Xu and Jinho D. Choi
  —
• DeepXML: A Deep Extreme Multi-Label Learning Framework Applied to Short Text Documents (2021)
  Kunal Dahiya et al.
  —
• Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answering (2023)
  Fangkai Yang et al.
  —
• FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering (2023)
  Zhenyu Li et al.
  —
• OpenBA: An Open-sourced 15B Bilingual Asymmetric seq2seq Model Pre-trained from Scratch (2023)
  Juntao Li et al.
  —
• Intelligent Virtual Assistants with LLM-based Process Automation (2023)
  Yanchu Guan et al.
  —
• Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptions (2024)
  Kexun Zhang et al.
  —
• JetMoE: Reaching Llama2 Performance with 0.1M Dollars (2024)
  Yikang Shen et al.
  —
• DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model (2024)
  DeepSeek-AI et al.
  —
• YuLan: An Open-source Large Language Model (2024)
  Yutao Zhu et al.
  —
• 7B Fully Open Source Moxin-LLM/VLM -- From Pretraining to GRPO-based Reinforcement Learning Enhancement (2024)
  Pu Zhao et al.
  —
• PaLM 2 Technical Report (2023)
  Rohan Anil et al.
  —
• Mind2Web: Towards a Generalist Agent for the Web (2023)
  Xiang Deng et al.
  —
• TableGPT: Towards Unifying Tables, Nature Language and Commands into One GPT (2023)
  Liangyu Zha et al.
  —
• FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets (2023)
  Seonghyeon Ye et al.
  —
• WebArena: A Realistic Web Environment for Building Autonomous Agents (2023)
  Shuyan Zhou et al.
  —
• Lemur: Harmonizing Natural Language and Code for Language Agents (2023)
  Yiheng Xu et al.
  —
• Ziya2: Data-centric Learning is All LLMs Need (2023)
  Ruyi Gan et al.
  —
• Advancing LLM Reasoning Generalists with Preference Trees (2024)
  Lifan Yuan et al.
  —
• CodecLM: Aligning Language Models with Tailored Synthetic Data (2024)
  Zifeng Wang et al.
  —
• OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework (2024)
  Sachin Mehta et al.
  —
• DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data (2024)
  Huajian Xin et al.
  —
• Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning (2024)
  Joongwon Kim et al.
  —
• Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients (2024)
  Aashiq Muhamed et al.
  —
• SciCode: A Research Coding Benchmark Curated by Scientists (2024)
  Minyang Tian et al.
  —
• OpenDevin: An Open Platform for AI Software Developers as Generalist Agents (2024)
  Xingyao Wang et al.
  —
• RoundTable: Leveraging Dynamic Schema and Contextual Autocomplete for Enhanced Query Precision in Tabular Question Answering (2024)
  Pratyush Kumar et al.
  —
• MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions (2024)
  Yekun Chai et al.
  —
• LLaMA-Mesh: Unifying 3D Mesh Generation with Language Models (2024)
  Zhengyi Wang et al.
  —