paper-with-me

홈 › Papers

LLM Test Generation via Iterative Hybrid Program Analysis

2025-03-17 · Sijia Gu, Noor Nashid, Ali Mesbah

Automating unit test generation remains a significant challenge, particularly for complex methods in real-world projects. While Large Language Models (LLMs) have made strides in code generation, they struggle to achieve high branch coverage due to their limited ability to reason about intricate control flow structures. To address this limitation, we introduce Panta, a technique that emulates the iterative process human developers follow when analyzing code and constructing test cases. Panta integrates static control flow analysis and dynamic code coverage analysis to systematically guide LLMs in identifying uncovered execution paths and generating better test cases. By incorporating an iterative feedback-driven mechanism, our technique continuously refines test generation based on static and dynamic path coverage insights, ensuring more comprehensive and effective testing. Our empirical evaluation, conducted on classes with high cyclomatic complexity from open-source projects, demonstrates that Panta achieves 26% higher line coverage and 23% higher branch coverage compared to the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2503.13580

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Similar Papers 제목 키워드 기반

CMSA algorithm for solving the prioritized pairwise test data generation problem in software product lines

2024-02-07 · Javier Ferrer, Francisco Chicano, José Antonio Ortega Toro

In Software Product Lines (SPLs) it may be difficult or even impossible to test all the products of the family because of the large number of valid feature combinations that may exist. Thus, we want to find a minimal sub…

Column Generation for Interaction Coverage in Combinatorial Software Testing

2017-12-19 · Serdar Kadioglu

This paper proposes a novel column generation framework for combinatorial software testing. In particular, it combines Mathematical Programming and Constraint Programming in a hybrid decomposition to generate covering ar…

software testing

SPARC: Scenario Planning and Reasoning for Automated C Unit Test Generation

2026-02-18 · Jaid Monwar Chowdhury, Chi-An Fu, Reyhaneh Jabbarvand arxiv

Automated unit test generation for C remains a formidable challenge due to the semantic gap between high-level program intent and the rigid syntactic constraints of pointer arithmetic and manual memory management. While …

LLMLOOP: Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loops

2026-03-24 · Ravin Ravi, Dylan Bradshaw, Stefano Ruberto, Gunel Jahangirova 외 arxiv

Large Language Models (LLMs) are showing remarkable performance in generating source code, yet the generated code often has issues like compilation errors or incorrect code. Researchers and developers often face wasted e…

LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic

2024-06-25 · Aditya Kalyanpur, Kailash Karthik Saravanakumar, Victor Barres, Jennifer Chu-Carroll 외

We introduce LLM-ARC, a neuro-symbolic framework designed to enhance the logical reasoning capabilities of Large Language Models (LLMs), by combining them with an Automated Reasoning Critic (ARC). LLM-ARC employs an Acto…

ARCLogical Reasoning