← all papers · overview

Targeted Efficient Fine-tuning: Optimizing Parameter Updates With Data-driven Sample Selection

Abstract

Fine-tuning all parameters of Large Language Models (LLMs) is computationally expensive. Parameter-Efficient Fine-Tuning (PEFT) methods address this by selectively fine-tuning specific parameters. Most of the parameter efficient fine-tuning (PEFT) methods center on selecting or introducing a set of parameters to be fine-tuned. However, there are few methods that consider the impact of data samples

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).