Code Generation 벤치마크
Code Generation on CodeXGLUE - CodeSearchNet
| Rank | Model | Java/EM | Python/EM | Java/BLEU | Python/BLEU | Java/CodeBLEU | Python/CodeBLEU | Extra Training Data | Paper | Code | Year |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Redcoder-ext | 10.21 | 9.61 | 28.98 | 24.43 | 33.18 | 30.21 | ✓ | Retrieval Augmented Code Generation and Summarization | kagnlp/CodeGenerator · rizwan09/redcoder | 2021 |
| 2 | GAP-Gen | - | - | - | 22.3 | – | 24.1 | ✓ | GAP-Gen: Guided Automatic Python Code Generation | rain9876/auto-code-generator | 2022 |