Code Generation
31개 벤치마크 · 논문 3,075편 · 이 태스크의 논문 보기 →
Benchmarks
Terminal-Bench Hard
LiveCodeBench
Terminal-Bench v2.1
SciCode
MBPP
APPS
CoNaLa
HumanEval
CodeContests
Django
WikiSQL
RES-Q
PECC
WebApp1K-React
CoNaLa-Ext
WebApp1k-Duo-React
DSEval-LeetCode
Turbulence
VerilogEval
Livecodebench
Shellcode_IA32
TACO-BAAI
BigCodeBench-Complete
BigCodeBench-Instruct
CONCODE
HumanEval-ET
MBPP-ET
Android Repos
FloCo
Most implemented
LLaMA: Open and Efficient Foundation Language Models
Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks
Llama 2: Open Foundation and Fine-Tuned Chat Models
Evaluating Large Language Models Trained on Code
GPT-4 Technical Report
pix2code: Generating Code from a Graphical User Interface Screenshot
Papers
Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability
On-Policy Distillation (OPD) trains a student on its own generations using teacher feedback. With different tokenizers, comparing teacher and student predictions requires alignment at both sequence and vocabulary levels.…
Mathematical ReasoningCode GenerationQuestioning the Questions: Sustaining Self-Evolution in Reasoning Models
Self-evolving reasoning models learn from their own generated questions, yet repeated self-training can lead to performance collapse. In this paper, we investigate why performance deteriorates over successive rounds and …
Mathematical ReasoningCode Generation4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes
We introduce 4DCodeBench, a benchmark for 4D inverse graphics through code generation, in which agents reconstruct dynamic scenes from video as executable graphics programs. To accomplish this, agents must translate visu…
Physical SimulationsCode GenerationCARM: Cancellation-Aware Response Masking for LLM Reinforcement Learning
Recent years have witnessed the rapid adoption of reinforcement learning (RL) in large language model (LLM) post-training, with substantial gains in mathematical reasoning and code generation. In practical systems, howev…
Mathematical ReasoningReinforcement LearningCode GenerationSmaller Models, Better Rejects: Preference Distillation Scaling
Preference distillation typically treats a teacher response as preferred and the student's own response as rejected. This assumes that self-generated failures are the most informative negatives and that rejects must come…
Knowledge DistillationMathematical ReasoningCode GenerationQuantCode Model: Specializing Language Models for Executable Algorithmic Trading Code
Large language models are strong general-purpose code generators, but executable algorithmic trading remains a demanding specialization target: a model must translate a natural-language strategy specification into correc…
Instruction FollowingCode Generation