paper-with-me

홈 › Papers

Large Language Model for Patent Concept Generation

2024-08-26 · Runtao Ren, Jian Ma, Jianxi Luo

In traditional innovation practices, concept and IP generation are often iteratively integrated. Both processes demand an intricate understanding of advanced technical domain knowledge. Existing large language models (LLMs), while possessing massive pre-trained knowledge, often fall short in the innovative concept generation due to a lack of specialized knowledge necessary for the generation. To bridge this critical gap, we propose a novel knowledge finetuning (KFT) framework to endow LLM-based AI with the ability to autonomously mine, understand, and apply domain-specific knowledge and concepts for invention generation, i.e., concept and patent generation together. Our proposed PatentGPT integrates knowledge injection pre-training (KPT), domain-specific supervised finetuning (SFT), and reinforcement learning from human feedback (RLHF). Extensive evaluation shows that PatentGPT significantly outperforms the state-of-the-art models on patent-related benchmark tests. Our method not only provides new insights into data-driven innovation but also paves a new path to fine-tune LLMs for applications in the context of technology. We also discuss the managerial and policy implications of AI-generating inventions in the future.

📄 PDF Abstract BibTeX arXiv:2409.00092

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Modelmodel

Similar Papers 제목 키워드 기반

Can Large Language Models Generate High-quality Patent Claims?

2024-06-27 · Lekang Jiang, Caiqi Zhang, Pascal A Scherz, Stephan Goetz

Large language models (LLMs) have shown exceptional performance across various text generation tasks but remain under-explored in the patent domain, which offers highly structured and precise language. This paper constru…

Text Generation

Agent Ideate: A Framework for Product Idea Generation from Patents Using Agentic AI

2025-07-02 · Gopichand Kanumolu, Ashok Urlana, Charaka Vinayak Kumar, Bala Mallikarjunarao Garlapati arxiv

Patents contain rich technical knowledge that can inspire innovative product ideas, yet accessing and interpreting this information remains a challenge. This work explores the use of Large Language Models (LLMs) and auto…

Towards Better Evaluation for Generated Patent Claims

2025-05-16 · Lekang Jiang, Pascal A Scherz, Stephan Goetz

Patent claims define the scope of protection and establish the legal boundaries of an invention. Drafting these claims is a complex and time-consuming process that usually requires the expertise of skilled patent attorne…

Measuring Patent Claim Generation by Span Relevancy

2019-08-26 · Jieh-Sheng Lee, Jieh Hsiang

Our goal of patent claim generation is to realize "augmented inventing" for inventors by leveraging latest Deep Learning techniques. We envision the possibility of building an "auto-complete" function for inventors to co…

Language ModellingNatural Language InferenceText Generation

LLM-based Extraction of Contradictions from Patents

2024-03-21 · Stefan Trapp, Joachim Warschat

Already since the 1950s TRIZ shows that patents and the technical contradictions they solve are an important source of inspiration for the development of innovative products. However, TRIZ is a heuristic based on a histo…

Language ModellingLarge Language ModelPrompt EngineeringQuestion Answering+2