Code Repair 벤치마크
Code Repair on CodeXGLUE - Bugs2Fix
| Rank | Model | Accuracy (medium) | Accuracy (small) | BLEU (medium) | BLEU (small) | CodeBLEU (medium) | CodeBLEU (small) | Paper | Code | Year |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | NSEdit | 13.87 | 24.04 | – | – | – | – | Fix Bugs with Transformer through a Neural-Symbolic Edit Grammar | 2022 | |
| 2 | CodeBERT | 5.2 | 16.4 | 91.07 | 77.42 | 87.52 | 75.58 | CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation | microsoft/CodeXGLUE · facebookresearch/CodeGen · sberbank-ai/fusion_brain_aij2021 · +4 | 2021 |