Hybrid-SQuAD: Hybrid Scholarly Question Answering Dataset
Existing Scholarly Question Answering (QA) methods typically target homogeneous data sources, relying solely on either text or Knowledge Graphs (KGs). However, scholarly information often spans heterogeneous sources, necessitating the development of QA systems that integrate information from multiple heterogeneous data sources. To address this challenge, we introduce Hybrid-SQuAD (Hybrid Scholarly Question Answering Dataset), a novel large-scale QA dataset designed to facilitate answering questions incorporating both text and KG facts. The dataset consists of 10.5K question-answer pairs generated by a large language model, leveraging the KGs DBLP and SemOpenAlex alongside corresponding text from Wikipedia. In addition, we propose a RAG-based baseline hybrid QA model, achieving an exact match score of 69.65 on the Hybrid-SQuAD test set.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsLanguage ModelingLanguage ModellingLarge Language ModelQuestion AnsweringRAGSimilar Papers 제목 키워드 기반
Integrating SPARQL and LLMs for Question Answering over Scholarly Data Sources
The Scholarly Hybrid Question Answering over Linked Data (QALD) Challenge at the International Semantic Web Conference (ISWC) 2024 focuses on Question Answering (QA) over diverse scholarly sources: DBLP, SemOpenAlex, and…
Extractive Question-AnsweringQuestion AnsweringContri(e)ve: Context + Retrieve for Scholarly Question Answering
Scholarly communication is a rapid growing field containing a wealth of knowledge. However, due to its unstructured and document format, it is challenging to extract useful information from them through conventional docu…
Information RetrievalKnowledge GraphsLanguage ModelingLanguage Modelling+4Augmenting Question Answering with A Hybrid RAG Approach
Retrieval-Augmented Generation (RAG) has emerged as a powerful technique for enhancing the quality of responses in Question-Answering (QA) tasks. However, existing approaches often struggle with retrieving contextually r…
Question AnsweringDual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answering
The current state-of-the-art generative models for open-domain question answering (ODQA) have focused on generating direct answers from unstructured textual information. However, a large amount of world's knowledge is st…
Open-Domain Question AnsweringQuestion AnsweringUsing the Hammer Only on Nails: A Hybrid Method for Evidence Retrieval for Question Answering
Evidence retrieval is a key component of explainable question answering (QA). We argue that, despite recent progress, transformer network-based approaches such as universal sentence encoder (USE-QA) do not always outperf…
Information RetrievalQuestion AnsweringRetrievalSentence