A Convolutional Neural Network-based Patent Image Retrieval Method for Design Ideation
The patent database is often used in searches of inspirational stimuli for innovative design opportunities because of its large size, extensive variety and rich design information in patent documents. However, most patent mining research only focuses on textual information and ignores visual information. Herein, we propose a convolutional neural network (CNN)-based patent image retrieval method. The core of this approach is a novel neural network architecture named Dual-VGG that is aimed to accomplish two tasks: visual material type prediction and international patent classification (IPC) class label prediction. In turn, the trained neural network provides the deep features in the image embedding vectors that can be utilized for patent image retrieval and visual mapping. The accuracy of both training tasks and patent image embedding space are evaluated to show the performance of our model. This approach is also illustrated in a case study of robot arm design retrieval. Compared to traditional keyword-based searching and Google image searching, the proposed method discovers more useful visual information for engineering design.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalPatent classificationRetrievalType predictionSimilar Papers 제목 키워드 기반
Guiding Data-Driven Design Ideation by Knowledge Distance
Data-driven conceptual design methods and tools aim to inspire human ideation for new design concepts by providing external inspirational stimuli. In prior studies, the stimuli have been limited in terms of coverage, gra…
Patent classificationRetrievalDeepPatent: Large scale patent drawing recognition and retrieval
We tackle the problem of analyzing and retrieving technical drawings. First, we introduce DeepPatent, a new large-scale dataset for recognition and retrieval of design patent drawings. The dataset provides more than 350,…
Image RetrievalRetrievalDesignCLIP: Multimodal Learning with CLIP for Design Patent Understanding
In the field of design patent analysis, traditional tasks such as patent classification and patent image retrieval heavily depend on the image data. However, patent images -- typically consisting of sketches with abstrac…
Contrastive LearningImage RetrievalTechNet: Technology Semantic Network Based on Patent Data
The growing developments in general semantic networks, knowledge graphs and ontology databases have motivated us to build a large-scale comprehensive semantic network of technology-related data for engineering knowledge …
Knowledge GraphsRetrievalSemantic Textual SimilarityHierarchical Multi-Positive Contrastive Learning for Patent Image Retrieval
Patent images are technical drawings that convey information about a patent's innovation. Patent image retrieval systems aim to search in vast collections and retrieve the most relevant images. Despite recent advances in…
Contrastive LearningDomain AdaptationImage RetrievalInformation Retrieval+1