Text Summarization 벤치마크
Text Summarization on WikiHow
ROUGE-1
- 2018-10-18 — Pointer-generator + coverage: ROUGE-1 28.53
- 2020-04-19 — MatchSum (BERT-base): ROUGE-1 31.85
- 2020-08-21 — BertSum: ROUGE-1 35.91
| Rank | Model | ROUGE-1 | ROUGE-2 | ROUGE-L | Content F1 | Paper | Code | Year |
|---|---|---|---|---|---|---|---|---|
| 1 | BertSum | 35.91 | 13.9 | 34.82 | 29.8 | Abstractive Summarization of Spoken andWritten Instructions with BERT | nlpyang/PreSumm · alebryvas/berk266 | 2020 |
| 2 | MatchSum (BERT-base) | 31.85 | 8.98 | 29.58 | – | Extractive Summarization as Text Matching | maszhongming/MatchSum · HHousen/TransformerSum | 2020 |
| 3 | Pointer-generator + coverage | 28.53 | 9.23 | 26.54 | – | WikiHow: A Large Scale Text Summarization Dataset | wikidepia/indonesian_datasets · Wikidepia/indonesia_dataset · dengyang17/wikihowQA · +6 | 2018 |