Specializing Joint Representations For The Task Of Product Recommendation

Abstract

We propose a unified product embedded representation that is optimized for the task of retrieval-based product recommendation. To this end, we introduce a new way to fuse modality-specific product embeddings into a joint product embedding, in order to leverage both product content information, such as textual descriptions and images, and product collaborative filtering signal. By introducing the fusion step at the very end of our architecture, we are able to train each modality separately, allowing us to keep a modular architecture that is preferable in real-world recommendation deployments. We analyze our performance on normal and hard recommendation setups such as cold-start and cross-category recommendations and achieve good performance on a large product shopping dataset.

Stats

• citations12
• S2 citations—
• github stars0
• HF likes0
• heat score8.35
• arxiv keynedelec2017specializing

Related papers

• Two Is Better Than One: Dual Embeddings For Complementary Product Recommendations (2022)6.34
• Self-supervised Multi-modal Sequential Recommendation (2023)0.00
• Asr-enhanced Multimodal Representation Learning For Cross-domain Product Retrieval (2024)0.00
• Joint Modeling And Optimization Of Search And Recommendation (2018)0.00
• Multimodal Semantic Retrieval For Product Search (2025)3.58
• Entity-graph Enhanced Cross-modal Pretraining For Instance-level Product Retrieval (2022)5.24
• Learning A Unified Embedding For Visual Search At Pinterest (2019)10.85
• Optimizing Product Deduplication In E-commerce With Multimodal Embeddings (2025)0.00