Code Generation on Django

11개 결과 · ⬇ CSV · JSON

Accuracy

Rank	Model	Accuracy	BLEU Score	Paper	Code	Year
1	MarianCG	81.83	90.41	MarianCG: a code generation transformer model inspired by machine translation	AhmedSSoliman/MarianCG-NL-to-Code	2022
2	TranX + BERT w/mined	81.03	79.86	The impact of lexical and grammatical processing on generating code from natural language	codegenfactors/BertranX · codegenfact/BertranX	2022
2	BERT + TAE	81.03	–	Code Generation from Natural Language with Less Prior and More Monolingual Data	borealisai/code-gen-tae	2021
4	Reranker	80.2	–	Reranking for Neural Semantic Parsing		2019
5	LUKEMarian	78.50	89.34	Leveraging pre-trained language models for code generation	AhmedSSoliman/Leveraging-Pretrained-Language-Models-for-Code-Generation	2024
6	RoBERTaMarian	77.95	88.91	Leveraging pre-trained language models for code generation	AhmedSSoliman/Leveraging-Pretrained-Language-Models-for-Code-Generation	2024
7	BERTMarian	76.68	56.55	Leveraging pre-trained language models for code generation	AhmedSSoliman/Leveraging-Pretrained-Language-Models-for-Code-Generation	2024
8	Tranx	73.7	–	TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation	pcyin/tranX · DeepLearnXMU/CG-RL · yuxiang2/CoNaLa · +1	2018
9	ELECTRAMarian	65.32	53.02	Leveraging pre-trained language models for code generation	AhmedSSoliman/Leveraging-Pretrained-Language-Models-for-Code-Generation	2024
10	lpn (Ling et al., 2016)	62.3	77.6	Latent Predictor Networks for Code Generation	deepmind/card2code · davidgolub/QuestionGeneration	2016
11	Phrasal Statistical MT (Ling et al., 2016)	31.5	47.6	Latent Predictor Networks for Code Generation	deepmind/card2code · davidgolub/QuestionGeneration	2016