paper-with-me

홈 › Papers

XCS as a reinforcement learning approach to automatic test case prioritization

2020-07-12 · GECCO 2020 7 · Lukas Rosenbauer, Anthony Stein, Roland Maier, David Pätzel, Jörg Hähner

Testing is a crucial part in the development of new products. With the rise of test automation methods, companies start relying on an even higher number of tests. Sometimes it is not feasible to run all tests and the goal is to determine which tests are crucial and which are less important. This prioritization problem has just recently gotten into the focus of reinforcement learning. A neural network combined with prioritized experience replay (ER) was used to identify critical tests. We are the first to apply XCS classifier systems (XCS) for this use case and reveal that XCS is not only suitable for this problem, but can also be superior to the aforementioned neural network and leads to more stable results. In this work, we adapt XCS's learning mechanism to the task by introducing a batch update which is based on Monte Carlo control. Further, we investigate if prioritized ER has the same positive effects on XCS as on the neural network for this test prioritization problem. Our experiments show that in general this is not the case for XCS.

📄 PDF Abstract BibTeX

Code (1)

LagLukas/XCS_TESTING

Tasks

reinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration

2018-11-09 · Helge Spieker, Arnaud Gotlieb, Dusica Marijan, Morten Mossige

Testing in Continuous Integration (CI) involves test case prioritization, selection, and execution at each cycle. Selecting the most promising test cases to detect bugs is hard if there are uncertainties on the impact of…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

XCSF for Automatic Test Case Prioritization

2020-11-04 · IJCCI 2020 11 · Lukas Rosenbauer, Anthony Stein, David Pätzel, Jörg Hähner

Testing is a crucial part in the development of a new product. Due to the change from manual testing to automated testing, companies can rely on a higher number of tests. There are certain cases such as smoke tests whe…

reinforcement-learningReinforcement Learning (RL)

XCSF with Experience Replay for Automatic Test Case Prioritization

2020-12-04 · IEEE Symposium Series on Computational Intelligence 2020 12 · Lukas Rosenbauer, Anthony Stein, David Pätzel, Jörg Hähner

The verification of a new product is of major importance for companies. With the rise of test automation, companies start to rely on huge numbers of tests. Often, it is not feasible to run all available tests due to time…

DeepOrder: Deep Learning for Test Case Prioritization in Continuous Integration Testing

2021-10-14 · Aizaz Sharif, Dusica Marijan, Marius Liaaen

Continuous integration testing is an important step in the modern software engineering life cycle. Test prioritization is a method that can improve the efficiency of continuous integration testing by selecting test cases…

Fault Detectionregression

Reinforcement Learning with Success Induced Task Prioritization

2022-12-30 · Maria Nesterova, Alexey Skrynnik, Aleksandr Panov

Many challenging reinforcement learning (RL) problems require designing a distribution of tasks that can be applied to train effective policies. This distribution of tasks can be specified by the curriculum. A curriculum…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)