paper-with-me

Papers

When Reasoning Hurts Legal Drafting: The Verbalization Bottleneck in Patent Claim Generation

2026-07-11 · Lekang Jiang, Wenjun Sun, Stephan Goetz arxiv

Patent claim drafting is a challenging legal drafting task that requires technical expertise, precise linguistic control, strict adherence to formal conventions, and the preservation of complex logical relationships among claim elements. While Chain-of-Thought (CoT) prompting has been widely used to improve the reasoning capabilities of large language models (LLMs), recent evidence suggests that its benefits may be limited, or even negative, in highly structured or pattern-sensitive tasks. Therefore, this paper investigates whether CoT prompting benefits patent claim generation. We propose a task-specific CoT method for patent claim generation and evaluate its effectiveness through both automatic metrics and human expert assessment. Our results show that reasoning-enhanced prompting can improve claim quality. Moreover, we demonstrate a counter-intuitive but important empirical finding: implicit CoT, where reasoning is kept internal rather than explicitly verbalized, consistently outperforms explicit CoT. Through systematic analysis, we show that explicit CoT can introduce an unnecessary information bottleneck for claim generation. Verbalized reasoning may compromise the quality of final outputs through three specific mechanisms: abstraction of critical details, disruption of internalized generation patterns, and cascading error propagation. Our findings provide new insights into legal tasks and CoT applications.

📄 PDF Abstract BibTeX arXiv:2607.10480

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Large Language Models in Cryptocurrency Securities Cases: Can a GPT Model Meaningfully Assist Lawyers?

2023-08-11 · Arianna Trozze, Toby Davies, Bennett Kleinberg

Large Language Models (LLMs) could be a useful tool for lawyers. However, empirical research on their effectiveness in conducting legal tasks is scant. We study securities cases involving cryptocurrencies as one of numer…

Decision MakingLegal Reasoning

Evaluating the Role of Large Language Models in Legal Practice in India

2025-08-13 · Rahul Hemrajani arxiv

The integration of Artificial Intelligence(AI) into the legal profession raises significant questions about the capacity of Large Language Models(LLM) to perform key legal tasks. In this paper, I empirically evaluate how…

CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generation

2025-02-25 · Haitao Li, Jiaying Ye, Yiran Hu, Jia Chen 외

Legal case documents play a critical role in judicial proceedings. As the number of cases continues to rise, the reliance on manual drafting of legal case documents is facing increasing pressure and challenges. The devel…

Legal Reasoning

The NAI Suite -- Drafting and Reasoning over Legal Texts

2019-10-15 · Tomer Libal, Alexander Steen

A prototype for automated reasoning over legal texts, called NAI, is presented. As an input, NAI accepts formalized logical representations of such legal texts that can be created and curated using an integrated annotati…

Benchmarking Patent Drafting from Inventor-Style Disclosures

2026-08-21 · Lekang Jiang, Wenjun Sun, Stephan Goetz arxiv

While recent large language models (LLMs) have achieved promising results on individual patent drafting tasks, they fundamentally fail to investigate the core challenge of real-world patent drafting: generating a complet…