← all papers · overview

Commonit: Commonality-aware Instruction Tuning For Large Language Models Via Data Partitions

Abstract

With instruction tuning, Large Language Models (LLMs) can enhance their ability to adhere to commands. Diverging from most works focusing on data mixing, our study concentrates on enhancing the model's capabilities from the perspective of data sampling during training. Drawing inspiration from the human learning process, where it is generally easier to master solutions to similar topics through fo

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).