Preference-based Interactive Multi-Document Summarisation

2019-06-07 · Yang Gao, Christian M. Meyer, Iryna Gurevych

Interactive NLP is a promising paradigm to close the gap between automatic NLP systems and the human upper bound. Preference-based interactive learning has been successfully applied, but the existing methods require several thousand interaction rounds even in simulations with perfect user feedback. In this paper, we study preference-based interactive summarisation. To reduce the number of interaction rounds, we propose the Active Preference-based ReInforcement Learning (APRIL) framework. APRIL uses Active Learning to query the user, Preference Learning to learn a summary ranking function from the preferences, and neural Reinforcement Learning to efficiently search for the (near-)optimal summary. Our results show that users can easily provide reliable preferences over summaries and that APRIL outperforms the state-of-the-art preference-based interactive method in both simulation and real-user experiments.

📄 PDF Abstract BibTeX arXiv:1906.02923

Code (1)

UKPLab/irj-neural-april 공식 구현

Tasks

Active Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

APRIL: Interactively Learning to Summarise by Combining Active Preference Learning and Reinforcement Learning

2018-08-29 · EMNLP 2018 10 · Yang Gao, Christian M. Meyer, Iryna Gurevych

We propose a method to perform automatic document summarisation without using reference summaries. Instead, our method interactively learns from users' preferences. The merit of preference-based interactive summarisation…

Active Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Proposal: Interactively Learning to Summarise Timelines by Reinforcement Learning

2021-08-01 · ACL (InterNLP) 2021 8 · Yuxuan Ye, Edwin Simpson

Timeline Summarisation (TLS) aims to generate a concise, time-ordered list of events described in sources such as news articles. However, current systems do not provide an adequate way to adapt to new domains nor to focu…

Articles reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Towards Abstractive Timeline Summarisation using Preference-based Reinforcement Learning

2022-11-14 · Yuxuan Ye, Edwin Simpson

This paper introduces a novel pipeline for summarising timelines of events reported by multiple news sources. Transformer-based models for abstractive summarisation generate coherent and concise summaries of long documen…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Towards Personalized and Human-in-the-Loop Document Summarization

2021-08-21 · Samira Ghodratnama

The ubiquitous availability of computing devices and the widespread use of the internet have generated a large amount of data continuously. Therefore, the amount of available information on any given topic is far beyond …

Document Summarization Feature Engineering

Optimising Factual Consistency in Summarisation via Preference Learning from Multiple Imperfect Metrics

2026-05-26 · Yuxuan Ye, Raul Santos-Rodriguez, Edwin Simpson arxiv

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underde…

Reinforcement Learning