Inverse Reinforcement Learning for Text Summarization
We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important sub-rewards for summarization and concurrently optimizes the policy network. Experimental results across datasets in different domains (CNN/DailyMail and WikiHow) and various model sizes (BART-base and BART-large) demonstrate the superiority of our proposed IRL model for summarization over MLE and RL baselines. The resulting summaries exhibit greater similarity to human-crafted gold references, outperforming MLE and RL baselines on metrics such as ROUGE, coverage, novelty, compression ratio, factuality, and human evaluations.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text Summarizationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Text SummarizationSimilar Papers 제목 키워드 기반
Exploring Computational User Models for Agent Policy Summarization
AI agents are being developed to support high stakes decision-making processes from driving cars to prescribing drugs, making it increasingly important for human users to understand their behavior. Policy summarization m…
Decision MakingImitation LearningReinforcement LearningAutomatic Text Summarization of Legal Cases: A Hybrid Approach
Manual Summarization of large bodies of text involves a lot of human effort and time, especially in the legal domain. Lawyers spend a lot of time preparing legal briefs of their clients' case files. Automatic Text summar…
ClusteringText SummarizationAutomatic Text Summarization Using Reinforcement Learning with Embedding Features
An automatic text summarization system can automatically generate a short and brief summary that contains a main concept of an original document. In this work, we explore the advantages of simple embedding features in Re…
ARCInformation Retrievalreinforcement-learningReinforcement Learning+2Deep Transfer Reinforcement Learning for Text Summarization
Deep neural networks are data hungry models and thus face difficulties when attempting to train on small text datasets. Transfer learning is a potential solution but their effectiveness in the text domain is not as explo…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Text Summarization+2Advancing Speech Summarization in Multi-modal LLMs with Reinforcement Learning
Speech summarization is a critical component of spoken content understanding, particularly in the era of rapidly growing spoken and audiovisual data. Recent advances in multi-modal large language models (MLLMs), leveragi…
Zero-shot GeneralizationReinforcement Learning