Code Generation 벤치마크
Code Generation on CONCODE
| Rank | Model | Exact Match | BLEU | CodeBLEU | Paper | Code | Year |
|---|---|---|---|---|---|---|---|
| 1 | Redcoder-ext | 23.4 | 42.5 | 43.4 | Retrieval Augmented Code Generation and Summarization | kagnlp/CodeGenerator · rizwan09/redcoder | 2021 |
| 2 | CodeT5 | 22.70 | 41.48 | 44.10 | CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation | salesforce/codet5 · salesforce/coderl · awsm-research/vulrepair · +2 | 2021 |