Query-Specific Knowledge Graphs for Complex Finance Topics
Across the financial domain, researchers answer complex questions by extensively "searching" for relevant information to generate long-form reports. This workshop paper discusses automating the construction of query-specific document and entity knowledge graphs (KGs) for complex research topics. We focus on the CODEC dataset, where domain experts (1) create challenging questions, (2) construct long natural language narratives, and (3) iteratively search and assess the relevance of documents and entities. For the construction of query-specific KGs, we show that state-of-the-art ranking systems have headroom for improvement, with specific failings due to a lack of context or explicit knowledge representation. We demonstrate that entity and document relevance are positively correlated, and that entity-based query feedback improves document ranking effectiveness. Furthermore, we construct query-specific KGs using retrieval and evaluate using CODEC's "ground-truth graphs", showing the precision and recall trade-offs. Lastly, we point to future work, including adaptive KG retrieval algorithms and GNN-based weighting methods, while highlighting key challenges such as high-quality data, information extraction recall, and the size and sparsity of complex topic graphs.
Code (0)
등록된 구현이 없습니다.
Tasks
Document RankingKnowledge GraphsRetrievalSimilar Papers 제목 키워드 기반
Thinking, Fast and Slow: Combining Vector Spaces and Knowledge Graphs
Knowledge graphs and vector space models are robust knowledge representation techniques with individual strengths and weaknesses. Vector space models excel at determining similarity between concepts, but are severely con…
Knowledge GraphsA Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
Reasoning over knowledge graphs (KGs) with first-order logic (FOL) queries is challenging due to the inherent incompleteness of real-world KGs and the compositional complexity of logical query structures. Most existing m…
Logical ReasoningKnowledge GraphsAn Inference Approach To Question Answering Over Knowledge Graphs
Knowledge Graphs (KG) act as a great tool for holding distilled information from large natural language text corpora. The problem of natural language querying over knowledge graphs is essential for the human consumption …
Knowledge GraphsQuestion AnsweringLearning to Rank Query Graphs for Complex Question Answering over Knowledge Graphs
In this paper, we conduct an empirical investigation of neural query graph ranking approaches for the task of complex question answering over knowledge graphs. We experiment with six different ranking models and propose …
Graph RankingKnowledge GraphsLearning-To-RankQuestion Answering+1LitCQD: Multi-Hop Reasoning in Incomplete Knowledge Graphs with Numeric Literals
Most real-world knowledge graphs, including Wikidata, DBpedia, and Yago are incomplete. Answering queries on such incomplete graphs is an important, but challenging problem. Recently, a number of approaches, including co…
Knowledge GraphsWorld Knowledge