← all papers · overview

Neuron-aware Data Selection In Instruction Tuning For Large Language Models

Abstract

Instruction Tuning (IT) has been proven to be an effective approach to unlock the powerful capabilities of large language models (LLMs). Recent studies indicate that excessive IT data can degrade LLMs performance, while carefully selecting a small subset of high-quality IT data can significantly enhance their capabilities. Therefore, identifying the most efficient subset data from the IT dataset t

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).