paper-with-me

홈 › Papers

Knowledge Graph - Deep Learning: A Case Study in Question Answering in Aviation Safety Domain

2022-05-31 · LREC 2022 6 · Ankush Agarwal, Raj Gite, Shreya Laddha, Pushpak Bhattacharyya, Satyanarayan Kar, Asif Ekbal, Prabhjit Thind, Rajesh Zele, Ravi Shankar

In the commercial aviation domain, there are a large number of documents, like, accident reports (NTSB, ASRS) and regulatory directives (ADs). There is a need for a system to access these diverse repositories efficiently in order to service needs in the aviation industry, like maintenance, compliance, and safety. In this paper, we propose a Knowledge Graph (KG) guided Deep Learning (DL) based Question Answering (QA) system for aviation safety. We construct a Knowledge Graph from Aircraft Accident reports and contribute this resource to the community of researchers. The efficacy of this resource is tested and proved by the aforesaid QA system. Natural Language Queries constructed from the documents mentioned above are converted into SPARQL (the interface language of the RDF graph database) queries and answered. On the DL side, we have two different QA models: (i) BERT QA which is a pipeline of Passage Retrieval (Sentence-BERT based) and Question Answering (BERT based), and (ii) the recently released GPT-3. We evaluate our system on a set of queries created from the accident reports. Our combined QA system achieves 9.3% increase in accuracy over GPT-3 and 40.3% increase over BERT QA. Thus, we infer that KG-DL performs better than either singly.

📄 PDF Abstract BibTeX arXiv:2205.15952

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language QueriesPassage RetrievalQuestion AnsweringRetrievalSentence

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Multi-Head Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

SPARQL Generation: an analysis on fine-tuning OpenLLaMA for Question Answering over a Life Science Knowledge Graph

2024-02-07 · Julio C. Rangel, Tarcisio Mendes de Farias, Ana Claudia Sima, Norio Kobayashi

The recent success of Large Language Models (LLM) in a wide range of Natural Language Processing applications opens the path towards novel Question Answering Systems over Knowledge Graphs leveraging LLMs. However, one of…

Data AugmentationKnowledge GraphsQuestion Answering

Message Passing for Complex Question Answering over Knowledge Graphs

2019-08-19 · Svitlana Vakulenko, Javier David Fernandez Garcia, Axel Polleres, Maarten de Rijke 외

Question answering over knowledge graphs (KGQA) has evolved from simple single-fact questions to complex questions that require graph traversal and aggregation. We propose a novel approach for complex KGQA that uses unsu…

Knowledge GraphsQuestion Answering

A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases

2023-11-13 · Juan Sequeda, Dean Allemang, Bryon Jacob

Enterprise applications of Large Language Models (LLMs) hold promise for question answering on enterprise SQL databases. However, the extent to which LLMs can accurately respond to enterprise questions in such databases …

Knowledge GraphsQuestion AnsweringText to SQLText-To-SQL

No One is Perfect: Analysing the Performance of Question Answering Components over the DBpedia Knowledge Graph

2018-09-26 · Kuldeep Singh, Ioanna Lytra, Arun Sethupat Radhakrishna, Saeedeh Shekarpour 외

Question answering (QA) over knowledge graphs has gained significant momentum over the past five years due to the increasing availability of large knowledge graphs and the rising importance of question answering for user…

Knowledge GraphsQuestion Answering

Fusing Knowledge and Language: A Comparative Study of Knowledge Graph-Based Question Answering with LLMs

2025-09-11 · Vaibhav Chaudhary, Neha Soni, Narotam Singh, Amita Kapoor arxiv

Knowledge graphs, a powerful tool for structuring information through relational triplets, have recently become the new front-runner in enhancing question-answering systems. While traditional Retrieval Augmented Generati…

Question AnsweringKnowledge Graphs