Coherence Evaluation 벤치마크
Coherence Evaluation on GCDC + RST - Accuracy
Accuracy
- 2018-05-14 — ParSeq: Accuracy 55.09
- 2020-09-30 — RST-Ensemble: Accuracy 55.39
- 2021-09-05 — MTL with Transformer: Accuracy 61.0
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | MTL with Transformer | 61.0 | Transformer Models for Text Coherence Assessment | LiamMaclean216/Pytorch-Transfomer · tushar117/Transformer-Models-for-Text-Coherence-Assessment | 2021 |
| 2 | RST-Ensemble | 55.39 | Neural RST-based Evaluation of Discourse Coherence | grig-guz/coherence-rst | 2020 |
| 3 | ParSeq | 55.09 | Discourse Coherence in the Wild: A Dataset, Evaluation and Methods | aylai/GCDC-corpus | 2018 |
| 4 | RST-Recursive | 53.04 | Neural RST-based Evaluation of Discourse Coherence | grig-guz/coherence-rst | 2020 |
| 5 | MTL with Transformer | 61.0 | Transformer Models for Text Coherence Assessment | LiamMaclean216/Pytorch-Transfomer · tushar117/Transformer-Models-for-Text-Coherence-Assessment | 2021 |
| 6 | RST-Ensemble | 55.39 | Neural RST-based Evaluation of Discourse Coherence | grig-guz/coherence-rst | 2020 |
| 7 | ParSeq | 55.09 | Discourse Coherence in the Wild: A Dataset, Evaluation and Methods | aylai/GCDC-corpus | 2018 |
| 8 | RST-Recursive | 53.04 | Neural RST-based Evaluation of Discourse Coherence | grig-guz/coherence-rst | 2020 |