paper-with-me

Code Documentation Generation 벤치마크

Code Documentation Generation on CodeSearchNet - Python

21개 결과 · ⬇ CSV · JSON

Smoothed BLEU-4

13.04 14.88 16.71 18.55 20.39 2020-02 2026-09 CodeBERT (MLM) — 15.48 (2020-02-19) CodeBERT (MLM+RTD) — 15.41 (2020-02-19) pre-train w/ code only — 15.12 (2020-02-19) RoBERTa — 14.92 (2020-02-19) Transformer — 13.44 (2020-02-19) seq2seq — 13.04 (2020-02-19) CodeBERT (MLM) — 15.48 (2020-02-19) CodeBERT (MLM+RTD) — 15.41 (2020-02-19) pre-train w/ code only — 15.12 (2020-02-19) RoBERTa — 14.92 (2020-02-19) Transformer — 13.44 (2020-02-19) seq2seq — 13.04 (2020-02-19) CodeBERT (MLM) — 15.48 (2020-02-19) CodeBERT (MLM+RTD) — 15.41 (2020-02-19) pre-train w/ code only — 15.12 (2020-02-19) RoBERTa — 14.92 (2020-02-19) Transformer — 13.44 (2020-02-19) seq2seq — 13.04 (2020-02-19) CodeTrans-MT-Base — 20.39 (2021-04-06) CodeTrans-MT-Base — 20.39 (2021-04-06) CodeTrans-MT-Base — 20.39 (2021-04-06) CodeBERT (MLM) — 15.48 (2020-02-19) CodeTrans-MT-Base — 20.39 (2021-04-06)
RankModel Smoothed BLEU-4 PaperCodeYear
1 CodeTrans-MT-Base 20.39 CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing agemagician/CodeTrans 2021
2 CodeBERT (MLM) 15.48 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
3 CodeBERT (MLM+RTD) 15.41 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
4 pre-train w/ code only 15.12 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
5 RoBERTa 14.92 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
6 Transformer 13.44 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
7 seq2seq 13.04 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
8 CodeTrans-MT-Base 20.39 CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing agemagician/CodeTrans 2021
9 CodeBERT (MLM) 15.48 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
10 CodeBERT (MLM+RTD) 15.41 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
11 pre-train w/ code only 15.12 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
12 RoBERTa 14.92 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
13 Transformer 13.44 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
14 seq2seq 13.04 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
15 CodeTrans-MT-Base 20.39 CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing agemagician/CodeTrans 2021
16 CodeBERT (MLM) 15.48 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
17 CodeBERT (MLM+RTD) 15.41 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
18 pre-train w/ code only 15.12 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
19 RoBERTa 14.92 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
20 Transformer 13.44 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
21 seq2seq 13.04 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
1–21 / 21 페이지당 10 20 50 100