MapCoder: Multi-Agent Code Generation for Competitive Problem Solving

2024-05-18 · Md. Ashraful Islam, Mohammed Eunus Ali, Md Rizwan Parvez

Code synthesis, which requires a deep understanding of complex natural language problem descriptions, generation of code instructions for complex algorithms and data structures, and the successful execution of comprehensive unit tests, presents a significant challenge. While large language models (LLMs) demonstrate impressive proficiency in natural language processing, their performance in code generation tasks remains limited. In this paper, we introduce a new approach to code generation tasks leveraging multi-agent prompting that uniquely replicates the full cycle of program synthesis as observed in human developers. Our framework, MapCoder, consists of four LLM agents specifically designed to emulate the stages of this cycle: recalling relevant examples, planning, code generation, and debugging. After conducting thorough experiments, with multiple LLM ablations and analyses across eight challenging competitive problem-solving and program synthesis benchmarks, MapCoder showcases remarkable code generation capabilities, achieving new state-of-the-art results (pass@1) on HumanEval (93.9%), MBPP (83.1%), APPS (22.0%), CodeContests (28.5%), and xCodeEval (45.3%). Moreover, our method consistently delivers superior performance across various programming languages and varying problem difficulties. We open-source our framework at https://github.com/Md-Ashraful-Pramanik/MapCoder.

📄 PDF Abstract BibTeX arXiv:2405.11403

Code (2)

md-ashraful-pramanik/mapcoder 공식 구현

Luoji-zju/Agents4PLC_release

Tasks

Code GenerationHumanEvalmbppProgram Synthesis

MapCoder-Lite: Distilling Multi-Agent Coding into a Single Small LLM

2025-09-22 · Woongkyu Lee, Junhee Cho, Jungwook Choi arxiv

Large language models (LLMs) have advanced code generation from single-function tasks to competitive-programming problems, but existing multi-agent solutions either rely on costly large-scale (>30B) models or collapse wh…

Code Generation

Adaptive Confidence Gating in Multi-Agent Collaboration for Efficient and Optimized Code Generation

2026-01-29 · Haoji Zhang, Yuzhe Li, Zhenqiang Liu, Chenyang Liu 외 arxiv

While Large Language Models (LLMs) have catalyzed breakthroughs in automated code generation, Small Language Models (SLMs) often encounter reasoning bottlenecks and failure loops when addressing complex logical requireme…

Code Generation

Thinking Before Running! Efficient Code Generation with Thorough Exploration and Optimal Refinement

2024-12-30 · Xiaoqing Zhang, YuHan Liu, Flood Sung, Xiuying Chen 외

Code generation is crucial in software engineering for automating the coding process efficiently. While test-time computation methods show promise, they suffer from high latency due to multiple computation rounds. To ove…

Code Generation HumanEval mbpp

CoopetitiveV: Leveraging LLM-powered Coopetitive Multi-Agent Prompting for High-quality Verilog Generation

2024-12-15 · Zhendong Mi, Renming Zheng, Haowen Zhong, Yue Sun 외

Recent advances in agentic LLMs have demonstrated great capabilities in Verilog code generation. However, existing approaches either use LLM-assisted single-agent prompting or cooperation-only multi-agent learning, which…

Code Generation Prompt Learning

Deep Latent Competition: Learning to Race Using Visual Control Policies in Latent Space

2021-02-19 · Wilko Schwarting, Tim Seyde, Igor Gilitschenski, Lucas Liebenwein 외

Learning competitive behaviors in multi-agent settings such as racing requires long-term reasoning about potential adversarial interactions. This paper presents Deep Latent Competition (DLC), a novel reinforcement learni…

Reinforcement Learning (RL)