Code Search 벤치마크
Code Search on CodeXGLUE - AdvTest
MRR
- 2021-02-09 — CodeBERT: MRR 27.19
- 2023-05-13 — CodeT5+ 770M: MRR 44.7
| Rank | Model | MRR | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | CodeT5+ 770M | 44.7 | CodeT5+: Open Code Large Language Models for Code Understanding and Generation | salesforce/codet5 · leiluk1/codesearcher | 2023 |
| 2 | CodeT5+ 220M | 43.3 | CodeT5+: Open Code Large Language Models for Code Understanding and Generation | salesforce/codet5 · leiluk1/codesearcher | 2023 |
| 3 | CodeBERT | 27.19 | CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation | microsoft/CodeXGLUE · facebookresearch/CodeGen · sberbank-ai/fusion_brain_aij2021 · +4 | 2021 |