Autoemb: Automated Embedding Dimensionality Search In Streaming Recommendations

Abstract

Deep learning based recommender systems (DLRSs) often have embedding layers, which are utilized to lessen the dimensionality of categorical variables (e.g. user/item identifiers) and meaningfully transform them in the low-dimensional space. The majority of existing DLRSs empirically pre-define a fixed and unified dimension for all user/item embeddings. It is evident from recent researches that different embedding sizes are highly desired for different users/items according to their popularity. However, manually selecting embedding sizes in recommender systems can be very challenging due to the large number of users/items and the dynamic nature of their popularity. Thus, in this paper, we propose an AutoML based end-to-end framework (AutoEmb), which can enable various embedding dimensions according to the popularity in an automated and dynamic manner. To be specific, we first enhance a typical DLRS to allow various embedding dimensions; then we propose an end-to-end differentiable frame

Stats

• citations47
• S2 citations—
• github stars0
• HF likes0
• heat score12.61
• arxiv keyzhao2020autoemb

Related papers

• Embedding In Recommender Systems: A Survey (2023)0.00
• CAFE: Towards Compact, Adaptive, And Fast Embedding For Large-scale Recommendation Models (2023)8.09
• Fine-grained Embedding Dimension Optimization During Training For Recommender Systems (2024)0.00
• Mem-rec: Memory Efficient Recommendation System Using Alternative Representation (2023)0.00
• Mixed-precision Embeddings For Large-scale Recommendation Models (2024)0.00
• Efficient Learning Of Sparse Representations From Interactions (2026)1.57
• Automated Similarity Metric Generation For Recommendation (2024)0.00
• Unified Semantic And ID Representation Learning For Deep Recommenders (2025)0.00