← all papers · overview

LEWIS (layer Wise Sparsity) -- A Training Free Guided Model Merging Approach

Abstract

As specialized large language models (LLMs) become increasingly prevalent, model merging methods are being used to combine them to create a single multi-task model without requiring any additional data or training. However, these approaches fall short when the objective of merging is to increase the downstream model's performance on a particular task-specific benchmark. In this work, we propose LE

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).