Plug-and-play Parameter-efficient Tuning Of Embeddings For Federated Recommendation

Abstract

With the rise of cloud-edge collaboration, recommendation services are increasingly trained in distributed environments. Federated Recommendation (FR) enables such multi-end collaborative training while preserving privacy by sharing model parameters instead of raw data. However, the large number of parameters, primarily due to the massive item embeddings, significantly hampers communication efficiency. While existing studies mainly focus on improving the efficiency of FR models, they largely overlook the issue of embedding parameter overhead. To address this gap, we propose a FR training framework with Parameter-Efficient Fine-Tuning (PEFT) based embedding designed to reduce the volume of embedding parameters that need to be transmitted. Our approach offers a lightweight, plugin-style solution that can be seamlessly integrated into existing FR methods. In addition to incorporating common PEFT techniques such as LoRA and Hash-based encoding, we explore the use of Residual Quantized Vari

Stats

• citations0
• S2 citations—
• github stars2
• HF likes0
• heat score0.95
• arxiv keyyuan2025plug

Related papers

• Lightfr: Lightweight Federated Recommendation With Privacy-preserving Matrix Factorization (2022)12.87
• Mixed-precision Embeddings For Large-scale Recommendation Models (2024)0.00
• Fine-grained Embedding Dimension Optimization During Training For Recommender Systems (2024)0.00
• PEFA: Parameter-free Adapters For Large-scale Embedding-based Retrieval Models (2023)7.73
• CAFE: Towards Compact, Adaptive, And Fast Embedding For Large-scale Recommendation Models (2023)8.09
• Refining Joint Text And Source Code Embeddings For Retrieval Task With Parameter-efficient Fine-tuning (2024)0.00
• Learning Compact Compositional Embeddings Via Regularized Pruning For Recommendation (2023)8.36
• Pfeed: Generating Near Real-time Personalized Feeds Using Precomputed Embedding Similarities (2024)0.00