Text Summarization on X-Sum

18개 결과 · ⬇ CSV · JSON

ROUGE-1

Rank	Model	ROUGE-1	ROUGE-2	ROUGE-3	ROUGE-L	Paper	Code	Year
1	Selfmem	50.30	26.70	41.60	–	Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory	hannibal046/selfmemory	2023
2	BRIO	49.07	25.59	40.40	–	BRIO: Bringing Order to Abstractive Summarization	yixinl7/brio · webis-de/summary-workbench · griff4692/edu-sum	2022
3	PEGASUS + SummaReranker	48.12	24.95	–	40.00	SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization	ntunlp/summareranker	2022
4	PEGASUS + SimCLS	47.61	24.57	–	39.44	SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization	yixinL7/SimCLS · andrejmiscic/simcls-pytorch	2021
5	PEGASUSLARGE	47.21	24.56	–	–	PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization	huggingface/transformers · google-research/pegasus · google-research/longt5 · +16	2019
6	HAT-BART	45.92	22.79	–	–	Hierarchical Learning for Generation with Long Source Sequences		2021
7	BART	45.14	22.27	37.25	–	BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension	huggingface/transformers · nlmatics/llmsherpa · facebookresearch/GENRE · +44	2019
8	BertSumExtAbs	38.81	16.50	31.27	–	Text Summarization with Pretrained Encoders	nlpyang/PreSumm · HHousen/TransformerSum · jananiarunachalam/Research-Paper-Summarization · +16	2019
9	T-ConvS2S	31.89	11.54	25.75	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
10	Baseline : Extractive Oracle	29.79	8.81	22.66	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
11	PtGen	29.70	9.21	23.24	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
12	Seq2Seq	28.42	8.77	22.48	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
13	PtGen-Covg	28.10	8.02	21.72	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
14	Baseline : Lead-3	16.30	1.60	11.95	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
15	Baseline : Random	15.16	1.78	11.27	–	Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization	shashiongithub/XSum · EdinburghNLP/XSum · pltrdy/extoracle_summarization	2018
16	PaLM 2-L (one-shot)	–	23.2	–	–	PaLM 2 Technical Report	eternityyw/tram-benchmark	2023
17	PaLM 2-M (one-shot)	–	17.2	–	–	PaLM 2 Technical Report	eternityyw/tram-benchmark	2023
18	PaLM 2-S (one-shot)	–	16.9	–	–	PaLM 2 Technical Report	eternityyw/tram-benchmark	2023