POIReviewQA: A Semantically Enriched POI Retrieval and Question Answering Dataset

2018-10-05 · Gengchen Mai, Krzysztof Janowicz, Cheng He, Sumang Liu, Ni Lao

Many services that perform information retrieval for Points of Interest (POI) utilize a Lucene-based setup with spatial filtering. While this type of system is easy to implement it does not make use of semantics but relies on direct word matches between a query and reviews leading to a loss in both precision and recall. To study the challenging task of semantically enriching POIs from unstructured data in order to support open-domain search and question answering (QA), we introduce a new dataset POIReviewQA. It consists of 20k questions (e.g."is this restaurant dog friendly?") for 1022 Yelp business types. For each question we sampled 10 reviews, and annotated each sentence in the reviews whether it answers the question and what the corresponding answer is. To test a system's ability to understand the text we adopt an information retrieval evaluation by ranking all the review sentences for a question based on the likelihood that they answer this question. We build a Lucene-based baseline model, which achieves 77.0% AUC and 48.8% MAP. A sentence embedding-based model achieves 79.2% AUC and 41.8% MAP, indicating that the dataset presents a challenging problem for future research by the GIR community. The result technology can help exploit the thematic content of web documents and social media for characterisation of locations.

📄 PDF Abstract BibTeX arXiv:1810.02802

Code (0)

등록된 구현이 없습니다.

Tasks

Information Retrieval Question Answering RetrievalSentenceSentence EmbeddingSentence-Embedding

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis

2024-10-01 · Reshmi Ghosh, Rahul Seetharaman, Hitesh Wadhwa, Somyaa Aggarwal 외

Retrieval Augmented Generation (RAG) is a widely used approach for leveraging external context in several natural language applications such as question answering and information retrieval. Yet, the exact nature in which…

Information Retrieval Language Modeling Language Modelling Question Answering+3

CG-RAG: Research Question Answering by Citation Graph Retrieval-Augmented LLMs

2025-01-25 · Yuntong Hu, Zhihan Lei, Zhongjie Dai, Allen Zhang 외

Research question answering requires accurate retrieval and contextual understanding of scientific literature. However, current Retrieval-Augmented Generation (RAG) methods often struggle to balance complex document rela…

Information Retrieval Question Answering RAG Retrieval+1

QAID: Question Answering Inspired Few-shot Intent Detection

2023-03-02 · Asaf Yehudai, Matan Vetzler, Yosi Mass, Koren Lazar 외

Intent detection with semantically similar fine-grained intents is a challenging task. To address it, we reformulate intent detection as a question-answering retrieval task by treating utterances and intent names as ques…

Intent Detection Question Answering Retrieval

Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrieval

2025-10-10 · Yu Wang, Tianhao Tan, Yifei Wang arxiv

Retrieving relevant instructional videos from multilingual medical archives is crucial for answering complex, multi-hop questions across language boundaries. However, existing systems either compress hour-long videos int…

An LLM-Powered AI Agent Framework for Holistic IoT Traffic Interpretation

2025-10-15 · Daniel Adu Worae, Spyridon Mastorakis arxiv

Internet of Things (IoT) networks generate diverse and high-volume traffic that reflects both normal activity and potential threats. Deriving meaningful insight from such telemetry requires cross-layer interpretation of …

Question Answering Anomaly Detection