NeuralQA: A Usable Library for Question Answering (Contextual Query Expansion + BERT) on Large Datasets
Existing tools for Question Answering (QA) have challenges that limit their use in practice. They can be complex to set up or integrate with existing infrastructure, do not offer configurable interactive interfaces, and do not cover the full set of subtasks that frequently comprise the QA pipeline (query expansion, retrieval, reading, and explanation/sensemaking). To help address these issues, we introduce NeuralQA - a usable library for QA on large datasets. NeuralQA integrates well with existing infrastructure (e.g., ElasticSearch instances and reader models trained with the HuggingFace Transformers API) and offers helpful defaults for QA subtasks. It introduces and implements contextual query expansion (CQE) using a masked language model (MLM) as well as relevant snippets (RelSnip) - a method for condensing large documents into smaller passages that can be speedily processed by a document reader model. Finally, it offers a flexible user interface to support workflows for research explorations (e.g., visualization of gradient-based explanations to support qualitative inspection of model behaviour) and large scale search deployment. Code and documentation for NeuralQA is available as open source on Github (https://github.com/victordibia/neuralqa}{Github).
Code (1)
Tasks
Language ModelingLanguage ModellingQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
Hierarchical Conditional Relation Networks for Video Question Answering
Video question answering (VideoQA) is challenging as it requires modeling capacity to distill dynamic visual artifacts and distant relations and to associate them with linguistic concepts. We introduce a general-purpose …
Audio-Visual Question Answering (AVQA)Question AnsweringRelationRelation Network+2SEGRA: A Structured Experience Guided Reasoning Agent for Property Graph Question Answering
Enterprise IT support knowledge graphs capture rich relationships among cases, users, devices, symptoms, taxonomic categories, root causes, and historical resolutions. Yet querying them in Gremlin requires knowledge of g…
NeuralQAAD: An Efficient Differentiable Framework for High Resolution Point Cloud Compression
In this paper, we propose NeuralQAAD, a differentiable point cloud compression framework that is fast, robust to sampling, and applicable to high resolutions. Previous work that is able to handle complex and non-smooth t…
Vocal Bursts Intensity PredictionTRACE: An Experiential Framework for Coherent Multi-hop Knowledge Graph Question Answering
Multi-hop Knowledge Graph Question Answering (KGQA) requires coherent reasoning across relational paths, yet existing methods often treat each reasoning step independently and fail to effectively leverage experience from…
Graph Question AnsweringTARSE: Test-Time Adaptation via Retrieval of Skills and Experience for Reasoning Agents
Complex clinical decision making often fails not because a model lacks facts, but because it cannot reliably select and apply the right procedural knowledge and the right prior example at the right reasoning step. We fra…
Test-time AdaptationQuestion AnsweringDecision Making