Language-driven Fine-grained Retrieval

Abstract

Existing fine-grained image retrieval (FGIR) methods learn discriminative embeddings by adopting semantically sparse one-hot labels derived from category names as supervision. While effective on seen classes, such supervision overlooks the rich semantics encoded in category names, hindering the modeling of comparability among cross-category details and, in turn, limiting generalization to unseen categories. To tackle this, we introduce LaFG, a Language-driven framework for Fine-Grained Retrieval that converts class names into attribute-level supervision using large language models (LLMs) and vision-language models (VLMs). Treating each name as a semantic anchor, LaFG prompts an LLM to generate detailed, attribute-oriented descriptions. To mitigate attribute omission in these descriptions, it leverages a frozen VLM to project them into a vision-aligned space, clustering them into a dataset-wide attribute vocabulary while harvesting complementary attributes from related categories. Lever

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2025language

Related papers

• Unifgvc: Universal Training-free Few-shot Fine-grained Vision Classification Via Attribute-aware Multimodal Retrieval (2025)0.00
• FLAIR: VLM With Fine-grained Language-informed Image Representations (2024)10.14
• Fine-grained Image Retrieval Via Dual-vision Adaptation (2025)0.00
• DVF: Advancing Robust And Accurate Fine-grained Image Retrieval With Retrieval Guidelines (2024)9.03
• Imagescope: Unifying Language-guided Image Retrieval Via Large Multimodal Model Collective Reasoning (2025)6.34
• One-shot Fine-grained Instance Retrieval (2017)10.35
• A Little More Like This: Text-to-image Retrieval With Vision-language Models Using Relevance Feedback (2025)0.00
• F2RVLM: Boosting Fine-grained Fragment Retrieval For Multi-modal Long-form Dialogue With Vision Language Model (2025)0.00