Cross-Document Language Modeling 벤치마크
Cross-Document Language Modeling on MultiNews test
Perplexity 낮을수록 좋음
- 2021-01-02 — CD-LM: Perplexity 1.76
| Rank | Model | Perplexity | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | CD-LM | 1.76 | CDLM: Cross-Document Language Modeling | aviclu/cdlm · aviclu/CD-LM | 2021 |
| 2 | Rand CD-LM | 1.93 | CDLM: Cross-Document Language Modeling | aviclu/cdlm · aviclu/CD-LM | 2021 |
| 3 | Longformer | 2.34 | CDLM: Cross-Document Language Modeling | aviclu/cdlm · aviclu/CD-LM | 2021 |