Autonomous QA Agent: A Retrieval-Augmented Framework for Reliable Selenium Script Generation

2025-11-28 · Dudekula Kasim Vali arxiv

Software testing is critical in the software development lifecycle, yet translating requirements into executable test scripts remains manual and error-prone. While Large Language Models (LLMs) can generate code, they often hallucinate non-existent UI elements. We present the Autonomous QA Agent, a Retrieval-Augmented Generation (RAG) system that grounds Selenium script generation in project-specific documentation and HTML structure. By ingesting diverse formats (Markdown, PDF, HTML) into a vector database, our system retrieves relevant context before generation. Evaluation on 20 e-commerce test scenarios shows our RAG approach achieves 100% (20/20) syntax validity and 90% (18/20, 95% CI: [85%, 95%], p < 0.001) execution success, compared to 30% for standard LLM generation. While our evaluation is limited to a single domain, our method significantly reduces hallucinations by grounding generation in actual DOM structure, demonstrating RAG's potential for automated UI testing.

📄 PDF Abstract BibTeX arXiv:2601.06034

Code (0)

등록된 구현이 없습니다.

SoK: Agentic Retrieval-Augmented Generation (RAG): Taxonomy, Architectures, Evaluation, and Research Directions

2026-03-07 · Saroj Mishra, Suman Niroula, Umesh Yadav, Dilip Thakur 외 arxiv

Retrieval-Augmented Generation (RAG) systems are increasingly evolving into agentic architectures where large language models autonomously coordinate multi-step reasoning, dynamic memory management, and iterative retriev…

PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agents

2024-07-12 · Saber Zerhoudi, Michael Granitzer

Large Language Models (LLMs) struggle with generating reliable outputs due to outdated knowledge and hallucinations. Retrieval-Augmented Generation (RAG) models address this by enhancing LLMs with external knowledge, but…

Information Retrieval Question Answering RAG Retrieval+1

MemArchitect: A Policy Driven Memory Governance Layer

2026-03-18 · Lingavasan Suresh Kumar, Yang Ba, Rong Pan arxiv

Persistent Large Language Model (LLM) agents expose a critical governance gap in memory management. Standard Retrieval-Augmented Generation (RAG) frameworks treat memory as passive storage, lacking mechanisms to resolve …

State and Memory is All You Need for Robust and Reliable AI Agents

2025-06-30 · Matthew Muhoberac, Atharva Parikh, Nirvi Vakharia, Saniya Virani 외

Large language models (LLMs) have enabled powerful advances in natural language understanding and generation. Yet their application to complex, real-world scientific workflows remain limited by challenges in memory, plan…

All Benchmarking Decision Making Natural Language Understanding+1

AutoAgent: Evolving Cognition and Elastic Memory Orchestration for Adaptive Agents

2026-03-10 · Xiaoxing Wang, Ning Liao, Shikun Wei, Chen Tang 외 arxiv

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and…