paper-with-me

홈 › Papers

PRIMG : Efficient LLM-driven Test Generation Using Mutant Prioritization

2025-05-08 · Mohamed Salah Bouafif, Mohammad Hamdaqa, Edward Zulkoski

Mutation testing is a widely recognized technique for assessing and enhancing the effectiveness of software test suites by introducing deliberate code mutations. However, its application often results in overly large test suites, as developers generate numerous tests to kill specific mutants, increasing computational overhead. This paper introduces PRIMG (Prioritization and Refinement Integrated Mutation-driven Generation), a novel framework for incremental and adaptive test case generation for Solidity smart contracts. PRIMG integrates two core components: a mutation prioritization module, which employs a machine learning model trained on mutant subsumption graphs to predict the usefulness of surviving mutants, and a test case generation module, which utilizes Large Language Models (LLMs) to generate and iteratively refine test cases to achieve syntactic and behavioral correctness. We evaluated PRIMG on real-world Solidity projects from Code4Arena to assess its effectiveness in improving mutation scores and generating high-quality test cases. The experimental results demonstrate that PRIMG significantly reduces test suite size while maintaining high mutation coverage. The prioritization module consistently outperformed random mutant selection, enabling the generation of high-impact tests with reduced computational effort. Furthermore, the refining process enhanced the correctness and utility of LLM-generated tests, addressing their inherent limitations in handling edge cases and complex program logic.

📄 PDF Abstract BibTeX arXiv:2505.05584

Code (1)

salah-sh/llm-mutation-testing 공식 구현

Similar Papers 제목 키워드 기반

Quality-Driven Selective Mutation for Deep Learning

2026-04-24 · Zaheed Ahmed, Emmanuel Charleson Dapaah, Philip Makedonski, Jens Grabowski arxiv

Mutants support testing and debugging in two roles: (i) as test goals and (ii) as substitutes for real faults. Hard-to-kill mutants provide better guidance for test improvement, while realism is essential when mutants ar…

Primitive Geometry Segment Pre-training for 3D Medical Image Segmentation

2024-01-08 · Ryu Tadokoro, Ryosuke Yamada, Kodai Nakashima, Ryo Nakamura 외

The construction of 3D medical image datasets presents several issues, including requiring significant financial costs in data collection and specialized expertise for annotation, as well as strict privacy concerns for p…

Image SegmentationMedical Image SegmentationSegmentationSelf-Supervised Learning+1

Mutation-Guided LLM-based Test Generation at Meta

2025-01-22 · Christopher Foster, Abhishek Gulati, Mark Harman, Inna Harper 외

This paper describes Meta's ACH system for mutation-guided LLM-based test generation. ACH generates relatively few mutants (aka simulated faults), compared to traditional mutation testing. Instead, it focuses on generati…

Study on the multiple characteristics of M3 generation of pea mutants obtained by neutron irradiation

2021-06-01 · Dapeng Xu, Ze'en Yao, Jianbin Pan, Huyuan Feng 외

Irradiation breeding is an important technique in the effort to solve food shortages and improve the quality of agricultural products. In this study, a field test was implemented on the M3 generation of two mutant pea pl…

On Accelerating Deep Neural Network Mutation Analysis by Neuron and Mutant Clustering

2025-01-22 · Lauren Lyons, Ali Ghanbari

Mutation analysis of deep neural networks (DNNs) is a promising method for effective evaluation of test data quality and model robustness, but it can be computationally expensive, especially for large models. To alleviat…

Clustering