paper-with-me

Papers

Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization

2024-06-01 · Shichao Sun, Ruifeng Yuan, Ziqiang Cao, Wenjie Li, PengFei Liu

Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the initial draft. Two strategies are designed to perform this iterative process: Prompt Chaining and Stepwise Prompt. Prompt chaining orchestrates the drafting, critiquing, and refining phases through a series of three discrete prompts, while Stepwise prompt integrates these phases within a single prompt. However, the relative effectiveness of the two methods has not been extensively studied. This paper is dedicated to examining and comparing these two methods in the context of text summarization to ascertain which method stands out as the most effective. Experimental results show that the prompt chaining method can produce a more favorable outcome. This might be because stepwise prompt might produce a simulated refinement process according to our various experiments. Since refinement is adaptable to diverse tasks, our conclusions have the potential to be extrapolated to other applications, thereby offering insights that may contribute to the broader development of LLMs.

📄 PDF Abstract BibTeX arXiv:2406.00507

Code (0)

등록된 구현이 없습니다.

Tasks

Text Summarization

Similar Papers 제목 키워드 기반

Answering Questions in Stages: Prompt Chaining for Contract QA

2024-10-09 · Adam Roegiest, Radha Chitta

Finding answers to legal questions about clauses in contracts is an important form of analysis in many legal workflows (e.g., understanding market trends, due diligence, risk mitigation) but more important is being able …

Multiple-choice

Large Language Model Prompt Chaining for Long Legal Document Classification

2023-08-08 · Dietrich Trautmann

Prompting is used to guide or steer a language model in generating an appropriate response that is consistent with the desired outcome. Chaining is a strategy used to decompose complex tasks into smaller, manageable comp…

Document ClassificationIn-Context LearningLanguage ModelingLanguage Modelling+1

Automating Categorization of Scientific Texts with In-Context Learning and Prompt-Chaining in Large Language Models

2026-04-25 · Gautam Kishore Shahi, Oliver Hummel arxiv

The relentless expansion of scientific literature presents significant challenges for navigation and knowledge discovery. Within Research Information Retrieval, established tasks such as text summarization and classifica…

Information RetrievalText SummarizationPrompt Engineering

Reliable generation of isomorphic physics problems using Generative AI with prompt-chaining and tool use

2025-08-20 · Zhongzhou Chen arxiv

We present a method for generating large numbers of isomorphic physics problems using generative AI services such as ChatGPT, through prompt chaining and tool use. This approach enables precise control over structural va…

Finding a Wolf in Sheep's Clothing: Combating Adversarial Text-To-Image Prompts with Text Summarization

2024-12-15 · Portia Cooper, Harshita Narnoli, Mihai Surdeanu

Text-to-image models are vulnerable to the stepwise "Divide-and-Conquer Attack" (DACA) that utilize a large language model to obfuscate inappropriate content in prompts by wrapping sensitive text in a benign narrative. T…

Adversarial TextBinary ClassificationLanguage ModelingLanguage Modelling+2