Text Generation 벤치마크
Text Generation on COCO Captions
BLEU-2
- 2016-09-18 — SeqGAN: BLEU-2 0.831
- 2017-05-31 — RankGAN: BLEU-2 0.85
- 2017-09-24 — LeakGAN: BLEU-2 0.95
| Rank | Model | BLEU-2 | BLEU-3 | BLEU-4 | BLEU-5 | Paper | Code | Year |
|---|---|---|---|---|---|---|---|---|
| 1 | LeakGAN | 0.950 | 0.880 | 0.778 | 0.686 | Long Text Generation via Adversarial Training with Leaked Information | CR-Gjx/LeakGAN · nurpeiis/LeakGAN-PyTorch · valko073/LyricsGANs · +3 | 2017 |
| 2 | partGAN | 0.910 | 0.713 | O.753 | 0.590 | Long Text Generation via Adversarial Training with Leaked Information | CR-Gjx/LeakGAN · nurpeiis/LeakGAN-PyTorch · valko073/LyricsGANs · +3 | 2017 |
| 3 | RankGAN | 0.850 | 0.672 | 0.557 | 0.544 | Adversarial Ranking for Language Generation | desire2020/RankGAN | 2017 |
| 4 | RelGAN (100) | 0.849 | 0.687 | 0.502 | – | RelGAN: Relational Generative Adversarial Networks for Text Generation | weilinie/RelGAN | 2019 |
| 5 | SeqGAN | 0.831 | 0.642 | 0.521 | 0.427 | SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient | LantaoYu/SeqGAN · suragnair/seqGAN · TalkToTheGAN/REGAN · +20 | 2016 |