A novel repetition normalized adversarial reward for headline generation

2019-02-19 · Peng Xu, Pascale Fung

While reinforcement learning can effectively improve language generation models, it often suffers from generating incoherent and repetitive phrases \cite{paulus2017deep}. In this paper, we propose a novel repetition normalized adversarial reward to mitigate these problems. Our repetition penalized reward can greatly reduce the repetition rate and adversarial training mitigates generating incoherent phrases. Our model significantly outperforms the baseline model on ROUGE-1\,(+3.24), ROUGE-L\,(+2.25), and a decreased repetition-rate (-4.98\%).

📄 PDF Abstract BibTeX arXiv:1902.07110

Code (0)

등록된 구현이 없습니다.

Tasks

Headline Generation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Text Generation

Clickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learning

2019-09-09 · IJCNLP 2019 11 · Peng Xu, Chien-Sheng Wu, Andrea Madotto, Pascale Fung

Sensational headlines are headlines that capture people's attention and generate reader interest. Conventional abstractive headline generation methods, unlike human writers, do not optimize for maximal reader attention. …

Headline Generation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Attractive or Faithful? Popularity-Reinforced Learning for Inspired Headline Generation

2020-02-06 · Yun-Zhu Song, Hong-Han Shuai, Sung-Lin Yeh, Yi-Lun Wu 외

With the rapid proliferation of online media sources and published news, headlines have become increasingly important for attracting readers to news articles, since users may be overwhelmed with the massive information. …

Articles Headline Generation Reinforcement Learning Reinforcement Learning (RL)+1

Stimulating Creativity with FunLines: A Case Study of Humor Generation in Headlines

2020-02-05 · ACL 2020 6 · Nabil Hossain, John Krumm, Tanvir Sajed, Henry Kautz

Building datasets of creative text, such as humor, is quite challenging. We introduce FunLines, a competitive game where players edit news headlines to make them funny, and where they rate the funniness of headlines edit…

Multiple News Headlines Generation using Page Metadata

2019-10-01 · WS 2019 10 · Kango Iwama, Yoshinobu Kano

Multiple headlines of a newspaper article have an important role to express the content of the article accurately and concisely. A headline depends on the content and intent of their article. While a single headline expr…

Headline Generation

Implicitly normalized forecaster with clipping for linear and non-linear heavy-tailed multi-armed bandits

2023-05-11 · Yuriy Dorn, Nikita Kornilov, Nikolay Kutuzov, Alexander Nazin 외

The Implicitly Normalized Forecaster (INF) algorithm is considered to be an optimal solution for adversarial multi-armed bandit (MAB) problems. However, most of the existing complexity results for INF rely on restrictive…

Multi-Armed Bandits