Invisible Relevance Bias: Text-image Retrieval Models Prefer Ai-generated Images

Abstract

With the advancement of generation models, AI-generated content (AIGC) is becoming more realistic, flooding the Internet. A recent study suggests that this phenomenon causes source bias in text retrieval for web search. Specifically, neural retrieval models tend to rank generated texts higher than human-written texts. In this paper, we extend the study of this bias to cross-modal retrieval. Firstly, we successfully construct a suitable benchmark to explore the existence of the bias. Subsequent extensive experiments on this benchmark reveal that AI-generated images introduce an invisible relevance bias to text-image retrieval models. Specifically, our experiments show that text-image retrieval models tend to rank the AI-generated images higher than the real images, even though the AI-generated images do not exhibit more visually relevant features to the query than real images. This invisible relevance bias is prevalent across retrieval models with varying training data and architectures

Stats

• citations16
• S2 citations—
• github stars0
• HF likes0
• heat score9.23
• arxiv keyxu2023invisible

Related papers

• Generative Ghost: Investigating Ranking Bias Hidden In Ai-generated Videos (2025)0.00
• Irgen: Generative Modeling For Image Retrieval (2023)7.16
• Mitigating Test-time Bias For Fair Image Retrieval (2023)0.00
• RAVID: Retrieval-augmented Visual Detection: A Knowledge-driven Approach For Ai-generated Image Identification (2025)0.00
• Do Neural Ranking Models Intensify Gender Bias? (2020)12.47
• Imagerag: Dynamic Image Retrieval For Reference-guided Image Generation (2025)0.00
• Debiasing Gender Bias In Information Retrieval Models (2022)0.00
• Genir: Generative Visual Feedback For Mental Image Retrieval (2025)0.00