Code Documentation Generation 벤치마크
Code Documentation Generation on CodeSearchNet - Java
Smoothed BLEU-4
- 2020-02-19 — CodeBERT (MLM+RTD): Smoothed BLEU-4 14.56
- 2021-04-06 — CodeTrans-MT-Large: Smoothed BLEU-4 21.87
| Rank | Model | Smoothed BLEU-4 | Paper | Code | Year |
|---|---|---|---|---|---|
| 21 | pre-train w/ code only | 13.07 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |
| 22 | CodeBERT (RTD) | 12.72 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |
| 23 | Transformer | 12.57 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |
| 24 | seq2seq | 11.42 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |