paper-with-me

홈 › Papers

Discourse-Aware Neural Rewards for Coherent Text Generation

2018-05-10 · NAACL 2018 6 · Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi

In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to approximate desired discourse structure. Empirical results demonstrate that a generator trained with the learned reward produces more coherent and less repetitive text than models trained with cross-entropy or with reinforcement learning with commonly used scores as rewards.

📄 PDF Abstract BibTeX arXiv:1805.03766

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)SentenceSentence OrderingText Generation

Similar Papers 제목 키워드 기반

Align to Structure: Aligning Large Language Models with Structural Information

2025-04-04 · Zae Myung Kim, Anand Ramachandran, Farideh Tavazoee, Joo-Kyung Kim 외

Generating long, coherent text remains a challenge for large language models (LLMs), as they lack hierarchical planning and structured organization in discourse generation. We introduce Structural Alignment, a novel meth…

Document SummarizationText Generation

Discourse-Aware Soft Prompting for Text Generation

2021-12-10 · Marjan Ghazvininejad, Vladimir Karpukhin, Vera Gor, Asli Celikyilmaz

Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, etc.) have optimized conditional text generation via training a small set of extra parameters of the neural language model, while freezing the rest fo…

BlockingConditional Text GenerationLanguage ModelingLanguage Modelling+1

Discourse-Aware Prompt Design for Text Generation

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, etc.) have optimized conditional text generation via training a small set of extra parameters of the neural language model, while freezing the rest fo…

BlockingConditional Text GenerationLanguage ModellingText Generation

Neural Net Models of Open-domain Discourse Coherence

2017-09-01 · EMNLP 2017 9 · Jiwei Li, Dan Jurafsky

Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. Yet existing models of coherence focus on measuring individual aspects of coherence (lex…

Abstractive Text SummarizationQuestion AnsweringSentence EmbeddingsText Generation

Neural Net Models for Open-Domain Discourse Coherence

2016-06-05 · Jiwei Li, Dan Jurafsky

Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. Yet existing models of coherence focus on measuring individual aspects of coherence (lex…

Text Generation