Code Documentation Generation 벤치마크
Code Documentation Generation on CodeSearchNet - JavaScript
Smoothed BLEU-4
- 2020-02-19 — Transformer: Smoothed BLEU-4 25.61
| Rank | Model | Smoothed BLEU-4 | Paper | Code | Year |
|---|---|---|---|---|---|
| 21 | CodeBERT (MLM) | 8.51 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |
| 22 | pre-train w/ code only | 8.3 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |
| 23 | seq2seq | 6.88 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |
| 24 | RoBERTa | 5.72 | CodeBERT: A Pre-Trained Model for Programming and Natural Languages | salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 | 2020 |