Unified Embedding Based Personalized Retrieval In Etsy Search

Abstract

Embedding-based neural retrieval is a prevalent approach to address the semantic gap problem which often arises in product search on tail queries. In contrast, popular queries typically lack context and have a broad intent where additional context from users historical interaction can be helpful. In this paper, we share our novel approach to address both: the semantic gap problem followed by an end to end trained model for personalized semantic retrieval. We propose learning a unified embedding model incorporating graph, transformer and term-based embeddings end to end and share our design choices for optimal tradeoff between performance and efficiency. We share our learnings in feature engineering, hard negative sampling strategy, and application of transformer model, including a novel pre-training strategy and other tricks for improving search relevance and deploying such a model at industry scale. Our personalized retrieval model significantly improves the overall search experience,

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keyjha2023unified

Related papers

• Neural IR Meets Graph Embedding: A Ranking Model For Product Search (2019)11.85
• Enhancing Relevance Of Embedding-based Retrieval At Walmart (2024)7.16
• Taxonomy-based Negative Sampling In Personalized Semantic Search For E-commerce (2025)0.00
• Session Context Embedding For Intent Understanding In Product Search (2024)0.00
• Embedding-based Retrieval In Facebook Search (2020)18.09
• Embedding-based Product Retrieval In Taobao Search (2021)13.70
• Pre-training Tasks For User Intent Detection And Embedding Retrieval In E-commerce Search (2022)9.41
• Mine And Refine: Optimizing Graded Relevance In E-commerce Search Retrieval (2026)0.00