Large Language Model Informed Patent Image Retrieval

Abstract

In patent prosecution, image-based retrieval systems for identifying similarities between current patent images and prior art are pivotal to ensure the novelty and non-obviousness of patent applications. Despite their growing popularity in recent years, existing attempts, while effective at recognizing images within the same patent, fail to deliver practical value due to their limited generalizability in retrieving relevant prior art. Moreover, this task inherently involves the challenges posed by the abstract visual features of patent images, the skewed distribution of image classifications, and the semantic information of image descriptions. Therefore, we propose a language-informed, distribution-aware multimodal approach to patent image feature learning, which enriches the semantic understanding of patent image by integrating Large Language Models and improves the performance of underrepresented classes with our proposed distribution-aware contrastive losses. Extensive experiments o

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylo2024large

Related papers

• Hierarchical Multi-positive Contrastive Learning For Patent Image Retrieval (2025)0.00
• Learning Efficient Representations For Image-based Patent Retrieval (2023)2.26
• Indexing Multimodal Language Models For Large-scale Image Retrieval (2026)0.00
• A Convolutional Neural Network-based Patent Image Retrieval Method For Design Ideation (2020)3.58
• Document Image Classification, With A Specific View On Applications Of Patent Images (2016)6.77
• Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models And Vision Language Models (2024)8.82
• ELIP: Enhanced Visual-language Foundation Models For Image Retrieval (2025)2.26
• Designclip: Multimodal Learning With CLIP For Design Patent Understanding (2025)0.00