← all papers · overview

X-PEFT: Extremely Parameter-efficient Fine-tuning For Extreme Multi-profile Scenarios

Abstract

Parameter-efficient fine-tuning (PEFT) techniques, such as adapter tuning, aim to fine-tune a pre-trained language model (PLM) using a minimal number of parameters for a specific task or profile. Although adapter tuning provides increased parameter efficiency compared to full-model fine-tuning, it introduces a small set of additional parameters attached to a PLM for each profile. This can become p

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).