← all papers · overview

Sens-merging: Sensitivity-guided Parameter Balancing For Merging Large Language Models

Abstract

Recent advances in large language models have led to numerous task-specialized fine-tuned variants, creating a need for efficient model merging techniques that preserve specialized capabilities while avoiding costly retraining. While existing task vector-based merging methods show promise, they typically apply uniform coefficients across all parameters, overlooking varying parameter importance bot

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).