Language Modelling 벤치마크
Language Modelling on Text8 dev
| Rank | Model | Bit per Character (BPC) | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | Transformer-LS (small) | 1.03 | Long-Short Transformer: Efficient Transformers for Language and Vision | keonlee9420/Comprehensive-Transformer-TTS · NVIDIA/transformer-ls · lucidrains/long-short-transformer | 2021 |