Harnessing the Power of Large Language Models for Software Testing Education: A Focus on ISTQB Syllabus
Software testing is a critical component in the software engineering field and is important for software engineering education. Thus, it is vital for academia to continuously improve and update educational methods to reflect the current state of the field. The International Software Testing Qualifications Board (ISTQB) certification framework is globally recognized and widely adopted in industry and academia. However, ISTQB-based learning has been rarely applied with recent generative artificial intelligence advances. Despite the growing capabilities of large language models (LLMs), ISTQB-based learning and instruction with LLMs have not been thoroughly explored. This paper explores and evaluates how LLMs can complement the ISTQB framework for higher education. The findings present four key contributions: (i) the creation of a comprehensive ISTQB-aligned dataset spanning over a decade, consisting of 28 sample exams and 1,145 questions; (ii) the development of a domain-optimized prompt that enhances LLM precision and explanation quality on ISTQB tasks; (iii) a systematic evaluation of state-of-the-art LLMs on this dataset; and (iv) actionable insights and recommendations for integrating LLMs into software testing education. These findings highlight the promise of LLMs in supporting ISTQB certification preparation and offer a foundation for their broader use in software engineering at higher education.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Harnessing the Power of LLMs: Automating Unit Test Generation for High-Performance Computing
Unit testing is crucial in software engineering for ensuring quality. However, it's not widely used in parallel and high-performance computing software, particularly scientific applications, due to their smaller, diverse…
From Code Generation to Software Testing: AI Copilot with Context-Based RAG
The rapid pace of large-scale software development places increasing demands on traditional testing methodologies, often leading to bottlenecks in efficiency, accuracy, and coverage. We propose a novel perspective on sof…
ChatbotCode GenerationRAGRetrieval-augmented Generation+1The Potential of LLMs in Automating Software Testing: From Generation to Reporting
Having a high quality software is essential in software engineering, which requires robust validation and verification processes during testing activities. Manual testing, while effective, can be time consuming and costl…
software testingTest It Before You Trust It: Applying Software Testing for Trustworthy In-context Learning
In-context learning (ICL) has emerged as a powerful capability of large language models (LLMs), enabling them to perform new tasks based on a few provided examples without explicit fine-tuning. Despite their impressive a…
In-Context LearningPhilosophyQuestion AnsweringSentiment Analysis+1Harnessing LLMs for API Interactions: A Framework for Classification and Synthetic Data Generation
As Large Language Models (LLMs) advance in natural language processing, there is growing interest in leveraging their capabilities to simplify software interactions. In this paper, we propose a novel system that integrat…
Dataset GenerationManagementSynthetic Data Generation