← all papers · overview

RECOST: External Knowledge Guided Data-efficient Instruction Tuning

Abstract

In the current landscape of large language models (LLMs), the process of instruction tuning serves as an essential step. Considering the high computing power overhead, data-efficient instruction tuning was proposed to reduce the training data size in this process, aiming at selecting high-quality instructional data. Nevertheless, we argue that most current data-efficient instruction-tuning methods

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).