Guided Code Generation with LLMs: A Multi-Agent Framework for Complex Code Tasks

2025-01-11 · Amr Almorsi, Mohanned Ahmed, Walid Gomaa

Large Language Models (LLMs) have shown remarkable capabilities in code generation tasks, yet they face significant limitations in handling complex, long-context programming challenges and demonstrating complex compositional reasoning abilities. This paper introduces a novel agentic framework for ``guided code generation'' that tries to address these limitations through a deliberately structured, fine-grained approach to code generation tasks. Our framework leverages LLMs' strengths as fuzzy searchers and approximate information retrievers while mitigating their weaknesses in long sequential reasoning and long-context understanding. Empirical evaluation using OpenAI's HumanEval benchmark with Meta's Llama 3.1 8B model (int4 precision) demonstrates a 23.79\% improvement in solution accuracy compared to direct one-shot generation. Our results indicate that structured, guided approaches to code generation can significantly enhance the practical utility of LLMs in software development while overcoming their inherent limitations in compositional reasoning and context handling.

📄 PDF Abstract BibTeX arXiv:2501.06625

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationHumanEvalLong-Context Understanding

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation

2026-04-18 · Qingyu Meng, Min Chen, Dingming Liu, Yifan Mo 외 arxiv

Large language models (LLMs) can generate fluent dialogue, but prior works lack situational grounding, dynamic strategy control, and evaluation aligned with clinical standards in motivational interviewing (MI). We introd…

Dialogue Generation

CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models

2024-11-07 · Jierui Li, Hung Le, Yingbo Zhou, Caiming Xiong 외

Pre-trained on massive amounts of code and text data, large language models (LLMs) have demonstrated remarkable achievements in performing code generation tasks. With additional execution-based feedback, these models can…

Code Generation Decision Making HumanEval mbpp

AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs

2026-04-14 · Manoj Madushanka Perera, Adnan Mahmood, Kasun Eranda Wijethilake, Quan Z. Sheng arxiv

Recent advancements in Large Language Models (LLMs) have improved their ability to process extended conversational contexts, yet fine-tuning and evaluating short- and long-term memories remain difficult due to the absenc…

Knowledge Graphs

MapCoder-Lite: Distilling Multi-Agent Coding into a Single Small LLM

2025-09-22 · Woongkyu Lee, Junhee Cho, Jungwook Choi arxiv

Large language models (LLMs) have advanced code generation from single-function tasks to competitive-programming problems, but existing multi-agent solutions either rely on costly large-scale (>30B) models or collapse wh…

Code Generation

Adaptive Confidence Gating in Multi-Agent Collaboration for Efficient and Optimized Code Generation

2026-01-29 · Haoji Zhang, Yuzhe Li, Zhenqiang Liu, Chenyang Liu 외 arxiv

While Large Language Models (LLMs) have catalyzed breakthroughs in automated code generation, Small Language Models (SLMs) often encounter reasoning bottlenecks and failure loops when addressing complex logical requireme…