paper-with-me

Papers

Large Language Model Prompt Chaining for Long Legal Document Classification

2023-08-08 · Dietrich Trautmann

Prompting is used to guide or steer a language model in generating an appropriate response that is consistent with the desired outcome. Chaining is a strategy used to decompose complex tasks into smaller, manageable components. In this study, we utilize prompt chaining for extensive legal document classification tasks, which present difficulties due to their intricate domain-specific language and considerable length. Our approach begins with the creation of a concise summary of the original document, followed by a semantic search for related exemplar texts and their corresponding annotations from a training corpus. Finally, we prompt for a label - based on the task - to assign, by leveraging the in-context learning from the few-shot prompt. We demonstrate that through prompt chaining, we can not only enhance the performance over zero-shot, but also surpass the micro-F1 score achieved by larger models, such as ChatGPT zero-shot, using smaller models.

📄 PDF Abstract BibTeX arXiv:2308.04138

Code (0)

등록된 구현이 없습니다.

Tasks

Document ClassificationIn-Context LearningLanguage ModelingLanguage ModellingLarge Language Model

Similar Papers 제목 키워드 기반

Answering Questions in Stages: Prompt Chaining for Contract QA

2024-10-09 · Adam Roegiest, Radha Chitta

Finding answers to legal questions about clauses in contracts is an important form of analysis in many legal workflows (e.g., understanding market trends, due diligence, risk mitigation) but more important is being able …

Multiple-choice

Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization

2024-06-01 · Shichao Sun, Ruifeng Yuan, Ziqiang Cao, Wenjie Li 외

Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the initial draft. Two strategies are designed t…

Text Summarization

Legal Syllogism Prompting: Teaching Large Language Models for Legal Judgment Prediction

2023-07-17 · Cong Jiang, Xiaolei Yang

Legal syllogism is a form of deductive reasoning commonly used by legal professionals to analyze cases. In this paper, we propose legal syllogism prompting (LoT), a simple prompting method to teach large language models …

Articles

Automating Categorization of Scientific Texts with In-Context Learning and Prompt-Chaining in Large Language Models

2026-04-25 · Gautam Kishore Shahi, Oliver Hummel arxiv

The relentless expansion of scientific literature presents significant challenges for navigation and knowledge discovery. Within Research Information Retrieval, established tasks such as text summarization and classifica…

Information RetrievalText SummarizationPrompt Engineering

Legal Prompt Engineering for Multilingual Legal Judgement Prediction

2022-12-05 · Dietrich Trautmann, Alina Petrova, Frank Schilder

Legal Prompt Engineering (LPE) or Legal Prompting is a process to guide and assist a large language model (LLM) with performing a natural legal language processing (NLLP) skill. Our goal is to use LPE with LLMs over long…

Language ModelingLanguage ModellingLarge Language ModelPrediction+1