← all papers · overview

Data-free Layer-adaptive Merging Via Fisher Information For Long-to-short Reasoning Llms

Tian Xia·2026

Abstract

Model merging has emerged as a practical approach to combine capabilities of specialized large language models (LLMs) without additional training. In the Long-to-Short (L2S) scenario, merging a base model with a long-chain-of-thought reasoning model aims to preserve reasoning accuracy while reducing output length. Existing methods rely on Task Arithmetic and its variants, which implicitly assume t

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).