A Convolutional Neural Network-based Patent Image Retrieval Method For Design Ideation

Abstract

The patent database is often used in searches of inspirational stimuli for innovative design opportunities because of its large size, extensive variety and rich design information in patent documents. However, most patent mining research only focuses on textual information and ignores visual information. Herein, we propose a convolutional neural network (CNN)-based patent image retrieval method. The core of this approach is a novel neural network architecture named Dual-VGG that is aimed to accomplish two tasks: visual material type prediction and international patent classification (IPC) class label prediction. In turn, the trained neural network provides the deep features in the image embedding vectors that can be utilized for patent image retrieval and visual mapping. The accuracy of both training tasks and patent image embedding space are evaluated to show the performance of our model. This approach is also illustrated in a case study of robot arm design retrieval. Compared to trad

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keyjiang2020a

Related papers

• Learning Efficient Representations For Image-based Patent Retrieval (2023)2.26
• Designclip: Multimodal Learning With CLIP For Design Patent Understanding (2025)0.00
• Hierarchical Multi-positive Contrastive Learning For Patent Image Retrieval (2025)0.00
• Large Language Model Informed Patent Image Retrieval (2024)0.00
• Patentnet: A Large-scale Incomplete Multiview, Multimodal, Multilabel Industrial Goods Image Database (2021)0.00
• Document Image Classification, With A Specific View On Applications Of Patent Images (2016)6.77
• Enhancing Patent Retrieval Using Text And Knowledge Graph Embeddings: A Technical Note (2022)10.07
• Picture It In Your Mind: Generating High Level Visual Representations From Textual Descriptions (2016)9.41