Instruct-SCTG: Guiding Sequential Controlled Text Generation through Instructions
Instruction-tuned large language models have shown remarkable performance in aligning generated text with user intentions across various tasks. However, maintaining human-like discourse structure in the generated text remains a challenging research question. In this paper, we propose Instruct-SCTG, a flexible and effective sequential framework that harnesses instruction-tuned language models to generate structurally coherent text in both fine-tuned and zero-shot setups. Our framework generates articles in a section-by-section manner, aligned with the desired human structure using natural language instructions. Furthermore, we introduce a new automatic metric that measures discourse divergence in a fuzzy manner. Extensive experiments on three datasets from representative domains of news and recipes demonstrate the state-of-the-art performance of our framework in imposing discourse structure during text generation, as verified by both automatic and human evaluation. Our code will be available on Github.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesText GenerationSimilar Papers 제목 키워드 기반
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models
We investigate the use of multimodal information contained in images as an effective method for enhancing the commonsense of Transformer models for text generation. We perform experiments using BART and T5 on concept-to-…
Concept-To-Text GenerationSpecificityText GenerationVisual GroundingSuccessfully Guiding Humans with Imperfect Instructions by Highlighting Potential Errors and Suggesting Corrections
Language models will inevitably err in situations with which they are unfamiliar. However, by effectively communicating uncertainties, they can still guide humans toward making sound decisions in those contexts. We demon…
Decision MakingSequential Decision MakingSequentially Controlled Text Generation
While GPT-2 generates sentences that are remarkably human-like, longer documents can ramble and do not follow human-like writing structure. We study the problem of imposing structure on long-range text. We propose a nove…
Text GenerationSequentially Controlled Text Generation
While GPT2 generates sentences that are remarkably human-like, longer documents can ramble and are structurally different from human-written articles. We study the problem of imposing structure on long-range text. We pro…
ArticlesText GenerationSeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting
3D affordance reasoning, the task of associating human instructions with the functional regions of 3D objects, is a critical capability for embodied agents. Current methods based on 3D Gaussian Splatting (3DGS) are funda…