MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution

2024-03-26 · Wei Tao, Yucheng Zhou, Yanlin Wang, Wenqiang Zhang, Hongyu Zhang, Yu Cheng

In software development, resolving the emergent issues within GitHub repositories is a complex challenge that involves not only the incorporation of new code but also the maintenance of existing code. Large Language Models (LLMs) have shown promise in code generation but face difficulties in resolving Github issues, particularly at the repository level. To overcome this challenge, we empirically study the reason why LLMs fail to resolve GitHub issues and analyze the major factors. Motivated by the empirical findings, we propose a novel LLM-based Multi-Agent framework for GitHub Issue reSolution, MAGIS, consisting of four agents customized for software evolution: Manager, Repository Custodian, Developer, and Quality Assurance Engineer agents. This framework leverages the collaboration of various agents in the planning and coding process to unlock the potential of LLMs to resolve GitHub issues. In experiments, we employ the SWE-bench benchmark to compare MAGIS with popular LLMs, including GPT-3.5, GPT-4, and Claude-2. MAGIS can resolve 13.94% GitHub issues, significantly outperforming the baselines. Specifically, MAGIS achieves an eight-fold increase in resolved ratio over the direct application of GPT-4, the advanced LLM.

📄 PDF Abstract BibTeX arXiv:2403.17927

Code (0)

등록된 구현이 없습니다.

Tasks

Code GenerationGitHub issue resolution

Methods 이 논문이 사용한 방법론

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음

Residual Connection 설명 없음

MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos

2026-07-16 · Ziren Gong, Xiaohan Li, Fabio Tosi, Ninghui Xu 외 arxiv

This paper presents MAGiSt3R, a multi-agent 3D reconstruction framework performing reconstruction and camera tracking for monocular RGB videos at almost 10 FPS. MAGiSt3R relies on a feed-forward model from the 3R family …

3D Reconstruction

MAGIS: Evidence-Based Multi-Agent Reasoning for Interpretable Strabismus Clinical Decision-Making

2026-06-08 · Xikai Tang, Yifan Wang, Jiafan Zhuang, Li Luo 외 arxiv

Strabismus is a common ocular disorder that requires fine-grained subtype diagnosis for individualized treatment planning. However, existing deep learning methods mainly provide diagnostic predictions without transparent…

Magistral

2025-06-12 · Mistral-AI, :, Abhinav Rastogi, Albert Q. Jiang 외

We introduce Magistral, Mistral's first reasoning model and our own scalable reinforcement learning (RL) pipeline. Instead of relying on existing implementations and RL traces distilled from prior models, we follow a gro…

Instruction Following Reinforcement Learning (RL)

Magis-Bench: Evaluating LLMs on Magistrate-Level Legal Tasks

2026-05-08 · Ramon Pires, Thales Sales Almeida, Celio Larcher Junior, Giovana Bonás 외 arxiv

Existing benchmarks for legal AI focus primarily on tasks where LLMs must produce legal arguments or documents, yet the capacity to \emph{judge} such arguments -- weighing competing claims, applying doctrine to facts, an…

Legal Reasoning

Imagisaurus: An Interactive Visualizer of Valence and Emotion in the Roget's Thesaurus

2015-09-01 · WS 2015 9 · Saif Mohammad