paper-with-me

Type prediction 벤치마크

Type prediction on ManyTypes4TypeScript

18개 결과 · ⬇ CSV · JSON

Average Accuracy

57.52 60.96 64.39 67.83 71.27 2018-10 2026-11 BERT — 57.52 (2018-10-11) BERT — 57.52 (2018-10-11) RoBERTa — 59.84 (2019-07-26) RoBERTa — 59.84 (2019-07-26) CodeBERT — 61.72 (2020-02-19) CodeBERT — 61.72 (2020-02-19) GraphCodeBERT — 62.51 (2020-09-17) GraphCodeBERT — 62.51 (2020-09-17) PolyGot — 61.29 (2021-12-03) GraphPolyGot — 61.0 (2021-12-03) PolyGot — 61.29 (2021-12-03) GraphPolyGot — 61.0 (2021-12-03) GraphCodeBERT-MT4TS — 63.42 (2022-10-17) GraphCodeBERT-MT4TS — 63.42 (2022-10-17) CodeTIDAL5 — 71.27 (2023-10-01) CodeTIDAL5 — 71.27 (2023-10-01) BERT — 57.52 (2018-10-11) RoBERTa — 59.84 (2019-07-26) CodeBERT — 61.72 (2020-02-19) GraphCodeBERT — 62.51 (2020-09-17) GraphCodeBERT-MT4TS — 63.42 (2022-10-17) CodeTIDAL5 — 71.27 (2023-10-01)
RankModel Average AccuracyAverage PrecisionAverage RecallAverage F1 PaperCodeYear
1 CodeTIDAL5 71.27––– Learning Type Inference for Enhanced Dataflow Analysis joernio/joernti-codetidal5 2023
2 GraphCodeBERT-MT4TS 63.42––– ManyTypes4TypeScript: A Comprehensive TypeScript Dataset for Sequence-Based Type Inference kevinjesse/graphcodebert-MT4TS 2022
3 GraphCodeBERT 62.5160.0661.0860.57 GraphCodeBERT: Pre-training Code Representations with Data Flow microsoft/CodeBERT 2020
4 CodeBERT 61.7259.3459.8059.57 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
5 PolyGot 61.2958.8158.9158.86 Multilingual training for Software Engineering 2021
6 GraphPolyGot 61.0058.3658.9158.63 Multilingual training for Software Engineering 2021
7 RoBERTa 59.8457.4557.6257.54 RoBERTa: A Robustly Optimized BERT Pretraining Approach huggingface/transformers · pytorch/fairseq · PaddlePaddle/PaddleNLP · +64 2019
8 CodeBERTa 59.8156.5756.8556.71
9 BERT 57.5254.1854.0254.10 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding huggingface/transformers · tensorflow/models · labmlai/annotated_deep_learning_paper_implementations · +531 2018
10 CodeTIDAL5 71.27––– Learning Type Inference for Enhanced Dataflow Analysis joernio/joernti-codetidal5 2023
11 GraphCodeBERT-MT4TS 63.42––– ManyTypes4TypeScript: A Comprehensive TypeScript Dataset for Sequence-Based Type Inference kevinjesse/graphcodebert-MT4TS 2022
12 GraphCodeBERT 62.5160.0661.0860.57 GraphCodeBERT: Pre-training Code Representations with Data Flow microsoft/CodeBERT 2020
13 CodeBERT 61.7259.3459.8059.57 CodeBERT: A Pre-Trained Model for Programming and Natural Languages salesforce/codet5 · microsoft/CodeBERT · graykode/commit-autosuggestions · +6 2020
14 PolyGot 61.2958.8158.9158.86 Multilingual training for Software Engineering 2021
15 GraphPolyGot 61.0058.3658.9158.63 Multilingual training for Software Engineering 2021
16 RoBERTa 59.8457.4557.6257.54 RoBERTa: A Robustly Optimized BERT Pretraining Approach huggingface/transformers · pytorch/fairseq · PaddlePaddle/PaddleNLP · +64 2019
17 CodeBERTa 59.8156.5756.8556.71
18 BERT 57.5254.1854.0254.10 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding huggingface/transformers · tensorflow/models · labmlai/annotated_deep_learning_paper_implementations · +531 2018
1–18 / 18 페이지당 10 20 50 100