Auto Debugging
1개 벤치마크 · 논문 4편 · 이 태스크의 논문 보기 →
Benchmarks
Big-bench Lite
Most implemented
PaLM: Scaling Language Modeling with Pathways
Papers
DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systems
Large language model (LLM)-based multi-agent systems are challenging to debug because failures often arise from long, branching interaction traces. The prevailing practice is to leverage LLMs for log-based failure locali…
Auto DebuggingM^3Builder: A Multi-Agent System for Automated Machine Learning in Medical Imaging
Agentic AI systems have gained significant attention for their ability to autonomously perform complex tasks. However, their reliance on well-prepared tools limits their applicability in the medical domain, which require…
Auto DebuggingFrom Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging
While large language models have made significant strides in code generation, the pass rate of the generated code is bottlenecked on subtle errors, often requiring human intervention to pass tests, especially for complex…
Auto DebuggingBug fixingCode GenerationHumanEval+1PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning, which drastically reduces the number of task-specific training examples needed t…
Auto DebuggingCode GenerationCommon Sense ReasoningCoreference Resolution+19