Benchmarking Geospatial Question Answering Engines using the Dataset GeoQuestions1089
We present the dataset GeoQuestions1089 for benchmarking geospatial question answering engines. GeoQuestions1089 is the largest such dataset available presently and it contains 1089 questions, their corresponding GeoSPARQL or SPARQL queries and their answers over the geospatial knowledge graph YAGO2geo. We use GeoQuestions1089 to evaluate the effectiveness and efficiency of geospatial question answering engines GeoQA2 (an extension of GeoQA developed by our group) and the system of Hamzei et al. (2022).
Code (1)
Tasks
BenchmarkingKnowledge Base Question AnsweringQuestion AnsweringSimilar Papers 제목 키워드 기반
Template-Based Question Answering over Linked Geospatial Data
Large amounts of geospatial data have been made available recently on the linked open data cloud and the portals of many national cartographic agencies (e.g., OpenStreetMap data, administrative geographies of various cou…
Question AnsweringSpatial-RAG: Spatial Retrieval Augmented Generation for Real-World Geospatial Reasoning Questions
Answering real-world geospatial questions--such as finding restaurants along a travel route or amenities near a landmark--requires reasoning over both geographic relationships and semantic user intent. However, existing …
Question AnsweringRAGRetrievalRetrieval-augmented Generation+2MapQA: Open-domain Geospatial Question Answering on Map Data
Geospatial question answering (QA) is a fundamental task in navigation and point of interest (POI) searches. While existing geospatial QA datasets exist, they are limited in both scale and diversity, often relying solely…
DiversityLanguage ModelingLanguage ModellingLarge Language Model+2Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrieval
Large language models (LLMs) have shown promising results in learning and contextualizing information from different forms of data. Recent advancements in foundational models, particularly those employing self-attention …
Question AnsweringTatarstan Toponyms: A Bilingual Dataset and Hybrid RAG System for Geospatial Question Answering
This paper addresses end-to-end geospatial question answering over multilingual toponymic data. We introduce a bilingual (Russian-Tatar) dataset of 9,688 toponyms with linguistic, etymological, and coordinate information…
Question Answering