Maybe You Are Looking For Croqs: Cross-modal Query Suggestion For Text-to-image Retrieval

Abstract

Query suggestion, a technique widely adopted in information retrieval, enhances system interactivity and the browsing experience of document collections. In cross-modal retrieval, many works have focused on retrieving relevant items from natural language queries, while few have explored query suggestion solutions. In this work, we address query suggestion in cross-modal retrieval, introducing a novel task that focuses on suggesting minimal textual modifications needed to explore visually consistent subsets of the collection, following the premise of ''Maybe you are looking for''. To facilitate the evaluation and development of methods, we present a tailored benchmark named CroQS. This dataset comprises initial queries, grouped result sets, and human-defined suggested queries for each group. We establish dedicated metrics to rigorously evaluate the performance of various methods on this task, measuring representativeness, cluster specificity, and similarity of the suggested queries to t

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypacini2024maybe

Related papers

• Ask&confirm: Active Detail Enriching For Cross-modal Retrieval With Partial Query (2021)11.68
• Recqr: Incorporating Conversational Query Rewriting To Improve Multimodal Image Retrieval (2026)0.00
• Flickr30k-cfq: A Compact And Fragmented Query Dataset For Text-image Retrieval (2024)3.58
• Telling The What While Pointing To The Where: Multimodal Queries For Image Retrieval (2021)10.07
• Multimodal Learned Sparse Retrieval For Image Suggestion (2024)0.00
• Cross-modal RAG: Sub-dimensional Text-to-image Retrieval-augmented Generation (2025)0.00
• Cross-media Similarity Evaluation For Web Image Retrieval In The Wild (2017)9.59
• End-to-end Knowledge Retrieval With Multi-modal Queries (2023)8.35