Overview Of The TREC 2023 Product Product Search Track

Abstract

This is the first year of the TREC Product search track. The focus this year was the creation of a reusable collection and evaluation of the impact of the use of metadata and multi-modal data on retrieval accuracy. This year we leverage the new product search corpus, which includes contextual metadata. Our analysis shows that in the product search domain, traditional retrieval systems are highly effective and commonly outperform general-purpose pretrained embedding models. Our analysis also evaluates the impact of using simplified and metadata-enhanced collections, finding no clear trend in the impact of the expanded collection. We also see some surprising outcomes; despite their widespread adoption and competitive performance on other tasks, we find single-stage dense retrieval runs can commonly be noncompetitive or generate low-quality results both in the zero-shot and fine-tuned domain.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycampos2023overview

Related papers

• Overview Of The TREC 2021 Deep Learning Track (2025)10.85
• Embedding-based Product Retrieval In Taobao Search (2021)13.70
• Team IELAB At TREC Clinical Trial Track 2023: Enhancing Clinical Trial Retrieval With Neural Rankers And Large Language Models (2024)0.00
• Multimodal Semantic Retrieval For Product Search (2025)3.58
• An Overview On The Evaluated Video Retrieval Tasks At TRECVID 2022 (2023)0.00
• MAKE: Vision-language Pre-training Based Product Retrieval In Taobao Search (2023)7.81
• Generative Relevance Feedback And Convergence Of Adaptive Re-ranking: University Of Glasgow Terrier Team At TREC DL 2023 (2024)0.00
• TRECVID 2019: An Evaluation Campaign To Benchmark Video Activity Detection, Video Captioning And Matching, And Video Search & Retrieval (2020)0.00