paper-with-me

Papers

Can Large Language Models Generate High-quality Patent Claims?

2024-06-27 · Lekang Jiang, Caiqi Zhang, Pascal A Scherz, Stephan Goetz

Large language models (LLMs) have shown exceptional performance across various text generation tasks but remain under-explored in the patent domain, which offers highly structured and precise language. This paper constructs a dataset to investigate the performance of current LLMs in patent claim generation. Our results demonstrate that generating claims based on patent descriptions outperforms previous research relying on abstracts. Interestingly, current patent-specific LLMs perform much worse than state-of-the-art general LLMs, highlighting the necessity for future research on in-domain LLMs. We also find that LLMs can produce high-quality first independent claims, but their performances markedly decrease for subsequent dependent claims. Moreover, fine-tuning can enhance the completeness of inventions' features, conceptual clarity, and feature linkage. Among the tested LLMs, GPT-4 demonstrates the best performance in comprehensive human evaluations by patent experts, with better feature coverage, conceptual clarity, and technical coherence. Despite these capabilities, comprehensive revision and modification are still necessary to pass rigorous patent scrutiny and ensure legal robustness.

📄 PDF Abstract BibTeX arXiv:2406.19465

Code (1)

scylj1/llm4dpcg 공식 구현 pytorch

Tasks

Text Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

AutoPatent: A Multi-Agent Framework for Automatic Patent Generation

2024-12-13 · Qiyao Wang, Shiwen Ni, Huaren Liu, Shule Lu 외

As the capabilities of Large Language Models (LLMs) continue to advance, the field of patent processing has garnered increased attention within the natural language processing community. However, the majority of research…

Text Generation

PatentLMM: Large Multimodal Model for Generating Descriptions for Patent Figures

2025-01-25 · Shreya Shukla, Nakul Sharma, Manish Gupta, Anand Mishra

Writing comprehensive and accurate descriptions of technical drawings in patent documents is crucial to effective knowledge sharing and enabling the replication and protection of intellectual property. However, automatio…

Large Language ModelMultimodal Large Language ModelPatent Figure Description Generation

PATENTWRITER: A Benchmarking Study for Patent Drafting with LLMs

2025-07-30 · Homaira Huda Shomee, Suman Kalyan Maity, Sourav Medya arxiv

Large language models (LLMs) have emerged as transformative approaches in several important fields. This paper aims for a paradigm shift for patent writing by leveraging LLMs to overcome the tedious patent-filing process…

PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims

2025-05-25 · Yongmin Yoo, Qiongkai Xu, Longbing Cao

Natural language generation (NLG) metrics play a central role in evaluating generated texts, but are not well suited for the structural and legal characteristics of patent documents. Large language models (LLMs) offer st…

Text Generation

Towards Better Evaluation for Generated Patent Claims

2025-05-16 · Lekang Jiang, Pascal A Scherz, Stephan Goetz

Patent claims define the scope of protection and establish the legal boundaries of an invention. Drafting these claims is a complex and time-consuming process that usually requires the expertise of skilled patent attorne…