paper-with-me

홈 › Papers

Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Survey

2024-12-29 · Junqiao Wang, Zeng Zhang, Yangfan He, Zihao Zhang, Yuyang Song, Tianyu Shi, Yuchen Li, Hengyuan Xu, Kunyu Wu, Xin Yi, Zhongwei Wan, Xinhang Yuan, Kuan Lu, Menghao Huo, Tang Jingqun, Guangwu Qian, Keqin Li, Qiuwu Chen, Lewei He

Reinforcement learning (RL) has emerged as a powerful paradigm for enhancing large language models (LLMs) in code generation and optimization. This survey systematically reviews RL-driven techniques across the code development lifecycle, from compiler-level optimizations and resource allocation strategies to end-to-end code synthesis frameworks. We first examine classical and modern RL algorithms -- spanning policy gradients, actor-critic methods, human-feedback alignment, and preference-based optimization -- and their adaptations to the unique challenges of code generation, such as sparse and delayed rewards. Next, we analyze key benchmarks, datasets, and evaluation metrics that drive progress in RL-augmented Code LLMs. Finally, we identify open problems, including the need for richer feedback sources, support for low-level and domain-specific languages, and methods to reduce computational overhead. By consolidating current insights and outlining future directions, this work aims to guide researchers and practitioners in leveraging RL to produce more robust, efficient, and human-aligned code generation systems.

📄 PDF Abstract BibTeX arXiv:2412.20367

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationCompiler Optimizationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Survey

Similar Papers 제목 키워드 기반

Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation

2024-12-18 · Benjamin Steenhoek, Michele Tufano, Neel Sundaresan, Alexey Svyatkovskiy

Software testing is a crucial but time-consuming aspect of software development, and recently, Large Language Models (LLMs) have gained popularity for automated test case generation. However, because LLMs are trained on …

software testing

Improving LLM Code Generation via Requirement-Aware Curriculum Reinforcement Learning

2026-05-01 · Shouyu Yin, Zhao Tian, Junjie Chen, Shikai Guo arxiv

Code generation, which aims to automatically generate source code from given programming requirements, has the potential to substantially improve software development efficiency. With the rapid advancement of large langu…

Reinforcement LearningCode Generation

Process-Supervised Reinforcement Learning for Code Generation

2025-02-03 · Yufan Ye, Ting Zhang, Wenbin Jiang, Hua Huang

Existing reinforcement learning strategies based on outcome supervision have proven effective in enhancing the performance of large language models(LLMs) for code generation. While reinforcement learning based on process…

Code Generationreinforcement-learningReinforcement Learning

Applying RLAIF for Code Generation with API-usage in Lightweight LLMs

2024-06-28 · Sujan Dutta, Sayantan Mahinder, Raviteja Anantha, Bortik Bandyopadhyay

Reinforcement Learning from AI Feedback (RLAIF) has demonstrated significant potential across various domains, including mitigating harm in LLM outputs, enhancing text summarization, and mathematical reasoning. This pape…

Code GenerationHallucinationMathematical ReasoningText Summarization

ReCode: Updating Code API Knowledge with Reinforcement Learning

2025-06-25 · Haoze Wu, Yunzhi Yao, Wenhao Yu, Huajun Chen 외

Large Language Models (LLMs) exhibit remarkable code generation capabilities but falter when adapting to frequent updates in external library APIs. This critical limitation, stemming from reliance on outdated API knowled…

Code Generationreinforcement-learningReinforcement Learning