Cosplade: Contextualizing SPLADE For Conversational Information Retrieval

Abstract

Conversational search is a difficult task as it aims at retrieving documents based not only on the current user query but also on the full conversation history. Most of the previous methods have focused on a multi-stage ranking approach relying on query reformulation, a critical intermediate step that might lead to a sub-optimal retrieval. Other approaches have tried to use a fully neural IR first-stage, but are either zero-shot or rely on full learning-to-rank based on a dataset with pseudo-labels. In this work, leveraging the CANARD dataset, we propose an innovative lightweight learning technique to train a first-stage ranker based on SPLADE. By relying on SPLADE sparse representations, we show that, when combined with a second-stage ranker based on T5Mono, the results are competitive on the TREC CAsT 2020 and 2021 tracks.

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keyhai2023cosplade

Related papers

• Disco: LLM Knowledge Distillation For Efficient Sparse Retrieval In Conversational Search (2024)5.84
• The Role Of Vocabularies In Learning Sparse Representations For Ranking (2025)0.00
• CONVERSER: Few-shot Conversational Dense Retrieval With Synthetic Data Generation (2023)8.25
• Naver Labs Europe (SPLADE) @ TREC Deep Learning 2022 (2023)0.00
• Mistral-splade: Llms For Better Learned Sparse Retrieval (2024)0.00
• CSPLADE: Learned Sparse Retrieval With Causal Language Models (2025)0.00
• Few-shot Conversational Dense Retrieval (2021)16.68
• Contextualized Query Embeddings For Conversational Search (2021)10.21