Mining Mathematical Documents for Question Answering via Unsupervised Formula Labeling
The increasing number of questions on Question Answering (QA) platforms like Math Stack Exchange (MSE) signifies a growing information need to answer math-related questions. However, there is currently very little research on approaches for an open data QA system that retrieves mathematical formulae using their concept names or querying formula identifier relationships from knowledge graphs. In this paper, we aim to bridge the gap by presenting data mining methods and benchmark results to employ Mathematical Entity Linking (MathEL) and Unsupervised Formula Labeling (UFL) for semantic formula search and mathematical question answering (MathQA) on the arXiv preprint repository, Wikipedia, and Wikidata, which is part of the Wikimedia ecosystem of free knowledge. Based on different types of information needs, we evaluate our system in 15 information need modes, assessing over 7,000 query results. Furthermore, we compare its performance to a commercial knowledge-base and calculation-engine (Wolfram Alpha) and search-engine (Google). The open source system is hosted by Wikimedia at https://mathqa.wmflabs.org. A demovideo is available at purl.org/mathqa.
Code (1)
Tasks
Entity LinkingKnowledge GraphsMathMathematical Question AnsweringQuestion AnsweringSimilar Papers 제목 키워드 기반
Unsupervised Domain Adaptation on Question-Answering System with Conversation Data
Machine reading comprehension (MRC) is a task for question answering that finds answers to questions from documents of knowledge. Most studies on the domain adaptation of MRC require documents describing knowledge of the…
Domain AdaptationMachine Reading ComprehensionQuestion AnsweringReading Comprehension+1Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering
Large Language Models (LLMs), excel in natural language understanding, but their capability for complex mathematical reasoning with an amalgamation of structured tables and unstructured text is uncertain. This study expl…
Arithmetic ReasoningMathematical ReasoningNatural Language UnderstandingQuestion AnsweringMining Implicit Relevance Feedback from User Behavior for Web Question Answering
Training and refreshing a web-scale Question Answering (QA) system for a multi-lingual commercial search engine often requires a huge amount of training examples. One principled idea is to mine implicit relevance feedbac…
Passage RankingQuestion AnsweringKorean-Specific Dataset for Table Question Answering
Existing question answering systems mainly focus on dealing with text data. However, much of the data produced daily is stored in the form of tables that can be found in documents and relational databases, or on the web.…
Language ModelingLanguage ModellingQuestion AnsweringUnsupervised Pre-trainingBridging the Gap between Language Model and Reading Comprehension: Unsupervised MRC via Self-Supervision
Despite recent success in machine reading comprehension (MRC), learning high-quality MRC models still requires large-scale labeled training data, even using strong pre-trained language models (PLMs). The pre-training tas…
Language ModelingLanguage ModellingMachine Reading ComprehensionQuestion Answering+4