paper-with-me

홈 › Papers

HumanEval on Latest GPT Models -- 2024

2024-02-20 · Daniel Li, Lincoln Murr

In 2023, we are using the latest models of GPT-4 to advance program synthesis. The large language models have significantly improved the state-of-the-art for this purpose. To make these advancements more accessible, we have created a repository that connects these models to Huamn Eval. This dataset was initally developed to be used with a language model called CODEGEN on natural and programming language data. The utility of these trained models is showcased by demonstrating their competitive performance in zero-shot Python code generation on HumanEval tasks compared to previous state-of-the-art solutions. Additionally, this gives way to developing more multi-step paradigm synthesis. This benchmark features 160 diverse problem sets factorized into multistep prompts that our analysis shows significantly improves program synthesis over single-turn inputs. All code is open source at https://github.com/daniel442li/gpt-human-eval .

📄 PDF Abstract BibTeX arXiv:2402.14852

Code (1)

daniel442li/gpt-human-eval 공식 구현

Tasks

Code GenerationHumanEvalLanguage ModelingLanguage ModellingProgram Synthesis

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Enhancement Protocol

2025-03-07 · Roham Koohestani, Philippe de Bekker, Maliheh Izadi

Benchmarks are essential for consistent evaluation and reproducibility. The integration of Artificial Intelligence into Software Engineering (AI4SE) has given rise to numerous benchmarks for tasks such as code generation…

BenchmarkingBug fixingCode GenerationHumanEval

WizardCoder: Empowering Code Large Language Models with Evol-Instruct

2023-06-14 · Ziyang Luo, Can Xu, Pu Zhao, Qingfeng Sun 외

Code Large Language Models (Code LLMs), such as StarCoder, have demonstrated exceptional performance in code-related tasks. However, most existing models are solely pre-trained on extensive raw code data without instruct…

Code GenerationHumanEvalmbpp

HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization

2024-02-26 · Qiwei Peng, Yekun Chai, Xuhong LI

Large language models (LLMs) have made significant progress in generating codes from textual prompts. However, existing benchmarks have mainly concentrated on translating English prompts to multilingual codes or have bee…

Code GenerationHumanEval

The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers

2024-04-03 · Hussein Mozannar, Valerie Chen, Mohammed Alsobay, Subhro Das 외

Evaluation of large language models for code has primarily relied on static benchmarks, including HumanEval (Chen et al., 2021), or more recently using human preferences of LLM responses. As LLMs are increasingly used as…

HumanEval

CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

2023-03-30 · Qinkai Zheng, Xiao Xia, Xu Zou, Yuxiao Dong 외

Large pre-trained code generation models, such as OpenAI Codex, can generate syntax- and function-correct code, making the coding of programmers more productive and our pursuit of artificial general intelligence closer. …

BenchmarkingCode GenerationHumanEval