Code Translation 벤치마크
Code Translation on CodeXGLUE - CodeTrans
| Rank | Model | Accuracy (C#→Java) | Accuracy (Java→C#) | BLEU (C#→Java) | BLEU (Java→C#) | CodeBLEU (C#→Java) | CodeBLEU (Java→C#) | Paper | Code | Year |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | CodeT5 | 66.90 | 65.90 | 79.87 | 84.03 | – | – | CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation | salesforce/codet5 · salesforce/coderl · awsm-research/vulrepair · +2 | 2021 |
| 2 | CodeBERT | 58 | 59 | 72.14 | 79.92 | 79.41 | 85.1 | CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation | microsoft/CodeXGLUE · facebookresearch/CodeGen · sberbank-ai/fusion_brain_aij2021 · +4 | 2021 |