XPath Agent: An Efficient XPath Programming Agent Based on LLM for Web Crawler
We present XPath Agent, a production-ready XPath programming agent specifically designed for web crawling and web GUI testing. A key feature of XPath Agent is its ability to automatically generate XPath queries from a set of sampled web pages using a single natural language query. To demonstrate its effectiveness, we benchmark XPath Agent against a state-of-the-art XPath programming agent across a range of web crawling tasks. Our results show that XPath Agent achieves comparable performance metrics while significantly reducing token usage and improving clock-time efficiency. The well-designed two-stage pipeline allows for seamless integration into existing web crawling or web GUI testing workflows, thereby saving time and effort in manual XPath query development. The source code for XPath Agent is available at https://github.com/eavae/feilian.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic XPath: Structured Agentic Memory Access for Conversational AI
Conversational AI (ConvAI) agents increasingly maintain structured memory to support long-term, task-oriented interactions. In-context memory approaches append the growing history to the model input, which scales poorly …
eXpath: Explaining Knowledge Graph Link Prediction with Ontological Closed Path Rules
Link prediction (LP) is crucial for Knowledge Graphs (KG) completion but commonly suffers from interpretability issues. While several methods have been proposed to explain embedding-based LP models, they are generally li…
Knowledge GraphsLink PredictionEnriching Existing Test Collections with OXPath
Extending TREC-style test collections by incorporating external resources is a time consuming and challenging task. Making use of freely available web data requires technical skills to work with APIs or to create a web s…
RetrievalFlexPath: Learned Semantic Path Priors for Image-Based Planning
Recent learning-based path planners use neural networks to process visual map representations and approximate heuristics for classical search algorithms, yielding near-optimal paths with reduced search effort. However, t…
Zero-shot GeneralizationExPath: Towards Explaining Targeted Pathways for Biological Knowledge Bases
Biological knowledge bases provide systemically functional pathways of cells or organisms in terms of molecular interaction. However, recognizing more targeted pathways, particularly when incorporating wet-lab experiment…
Graph LearningMambaProtein Language Model