paper-with-me

홈 › Papers

Question Calibration and Multi-Hop Modeling for Temporal Question Answering

2024-02-20 · Chao Xue, Di Liang, Pengfei Wang, Jing Zhang

Many models that leverage knowledge graphs (KGs) have recently demonstrated remarkable success in question answering (QA) tasks. In the real world, many facts contained in KGs are time-constrained thus temporal KGQA has received increasing attention. Despite the fruitful efforts of previous models in temporal KGQA, they still have several limitations. (I) They adopt pre-trained language models (PLMs) to obtain question representations, while PLMs tend to focus on entity information and ignore entity transfer caused by temporal constraints, and finally fail to learn specific temporal representations of entities. (II) They neither emphasize the graph structure between entities nor explicitly model the multi-hop relationship in the graph, which will make it difficult to solve complex multi-hop question answering. To alleviate this problem, we propose a novel Question Calibration and Multi-Hop Modeling (QC-MHM) approach. Specifically, We first calibrate the question representation by fusing the question and the time-constrained concepts in KG. Then, we construct the GNN layer to complete multi-hop message passing. Finally, the question representation is combined with the embedding output by the GNN to generate the final prediction. Empirical results verify that the proposed model achieves better performance than the state-of-the-art models in the benchmark dataset. Notably, the Hits@1 and Hits@10 results of QC-MHM on the CronQuestions dataset's complex questions are absolutely improved by 5.1% and 1.2% compared to the best-performing baseline. Moreover, QC-MHM can generate interpretable and trustworthy predictions.

📄 PDF Abstract BibTeX arXiv:2402.13188

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge GraphsMulti-hop Question AnsweringQuestion Answering

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries

2024-12-26 · Roberto Amoroso, Gengyuan Zhang, Rajat Koner, Lorenzo Baraldi 외

Video Question Answering (Video QA) is a challenging video understanding task that requires models to comprehend entire videos, identify the most relevant information based on contextual cues from a given question, and r…

Question AnsweringVideo Question AnsweringVideo Understanding

Mitigating Temporal Misalignment by Discarding Outdated Facts

2023-05-24 · Michael J. Q. Zhang, Eunsol Choi

While large language models are able to retain vast amounts of world knowledge seen during pretraining, such knowledge is prone to going out of date and is nontrivial to update. Furthermore, these models are often used u…

Question AnsweringRetrievalWorld Knowledge

Video Question Answering via Attribute-Augmented Attention Network Learning

2017-07-20 · Yunan Ye, Zhou Zhao, Yimeng Li, Long Chen 외

Video Question Answering is a challenging problem in visual information retrieval, which provides the answer to the referenced video content according to the question. However, the existing visual question answering appr…

AttributeInformation RetrievalMultiple-choiceQuestion Answering+5

ATM: Action Temporality Modeling for Video Question Answering

2023-09-05 · Junwen Chen, Jie Zhu, Yu Kong

Despite significant progress in video question answering (VideoQA), existing methods fall short of questions that require causal/temporal reasoning across frames. This can be attributed to imprecise motion representation…

Contrastive LearningOptical Flow EstimationQuestion AnsweringVideo Question Answering

Question-Aware Gaussian Experts for Audio-Visual Question Answering

2025-03-06 · CVPR 2025 1 · Hongyeob Kim, Inyoung Jung, Dayoon Suh, Youjia Zhang 외

Audio-Visual Question Answering (AVQA) requires not only question-based multimodal reasoning but also precise temporal grounding to capture subtle dynamics for accurate prediction. However, existing methods mainly use qu…

Audio-visual Question AnsweringAudio-Visual Question Answering (AVQA)AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)Mixture-of-Experts+3