paper-with-me

Papers

Identifying Flaky Tests in Quantum Code: A Machine Learning Approach

2025-02-06 · Khushdeep Kaur, Dongchan Kim, Ainaz Jamshidi, Lei Zhang

Testing and debugging quantum software pose significant challenges due to the inherent complexities of quantum mechanics, such as superposition and entanglement. One challenge is indeterminacy, a fundamental characteristic of quantum systems, which increases the likelihood of flaky tests in quantum programs. To the best of our knowledge, there is a lack of comprehensive studies on quantum flakiness in the existing literature. In this paper, we present a novel machine learning platform that leverages multiple machine learning models to automatically detect flaky tests in quantum programs. Our evaluation shows that the extreme gradient boosting and decision tree-based models outperform other models (i.e., random forest, k-nearest neighbors, and support vector machine), achieving the highest F1 score and Matthews Correlation Coefficient in a balanced dataset and an imbalanced dataset, respectively. Furthermore, we expand the currently limited dataset for researchers interested in quantum flaky tests. In the future, we plan to explore the development of unsupervised learning techniques to detect and classify quantum flaky tests more effectively. These advancements aim to improve the reliability and robustness of quantum software testing.

📄 PDF Abstract BibTeX arXiv:2502.04471

Code (0)

등록된 구현이 없습니다.

Tasks

software testing

Similar Papers 제목 키워드 기반

Automating Quantum Software Maintenance: Flakiness Detection and Root Cause Analysis

2024-10-31 · Janakan Sivaloganathan, Ainaz Jamshidi, Andriy Miranskyy, Lei Zhang

Flaky tests, which pass or fail inconsistently without code changes, are a major challenge in software engineering in general and in quantum software engineering in particular due to their complexity and probabilistic na…

Automating Detection and Root-Cause Analysis of Flaky Tests in Quantum Software

2026-03-09 · Janakan Sivaloganathan, Ainaz Jamshidi, Andriy Miranskyy, Lei Zhang arxiv

Like classical software, quantum software systems rely on automated testing. However, their inherently probabilistic outputs make them susceptible to quantum flakiness -- tests that pass or fail inconsistently without co…

FlakyGuard: Automatically Fixing Flaky Tests at Industry Scale

2025-11-18 · Chengpeng Li, Farnaz Behrang, August Shi, Peng Liu arxiv

Flaky tests that non-deterministically pass or fail waste developer time and slow release cycles. While large language models (LLMs) show promise for automatically repairing flaky tests, existing approaches like FlakyDoc…

FlaKat: A Machine Learning-Based Categorization Framework for Flaky Tests

2024-03-01 · Shizhe Lin, Ryan Zheng He Liu, Ladan Tahvildari

Flaky tests can pass or fail non-deterministically, without alterations to a software system. Such tests are frequently encountered by developers and hinder the credibility of test suites. State-of-the-art research incor…

FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair

2023-06-21 · Sakina Fatima, Hadi Hemmati, Lionel Briand

Flaky tests are problematic because they non-deterministically pass or fail for the same software version under test, causing confusion and wasting development effort. While machine learning models have been used to pred…

Code RepairFew-Shot LearningIn-Context LearningLanguage Modelling+1