Chain-of-Skills: A Configurable Model for Open-domain Question Answering
The retrieval model is an indispensable component for real-world knowledge-intensive tasks, e.g., open-domain question answering (ODQA). As separate retrieval skills are annotated for different datasets, recent work focuses on customized methods, limiting the model transferability and scalability. In this work, we propose a modular retriever where individual modules correspond to key skills that can be reused across datasets. Our approach supports flexible skill configurations based on the target domain to boost performance. To mitigate task interference, we design a novel modularization parameterization inspired by sparse Transformer. We demonstrate that our model can benefit from self-supervised pretraining on Wikipedia and fine-tuning using multiple ODQA datasets, both in a multi-task fashion. Our approach outperforms recent self-supervised retrievers in zero-shot evaluations and achieves state-of-the-art fine-tuned retrieval performance on NQ, HotpotQA and OTT-QA.
Code (1)
Tasks
Open-Domain Question AnsweringQuestion AnsweringRetrievalWorld KnowledgeMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining
We introduce skill chaining, a skill discovery method for reinforcement learning agents in continuous domains, that builds chains of skills leading to an end-of-task reward. We demonstrate experimentally that it creates …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)healthAIChain: Improving security and safety using Blockchain Technology applications in AI-based healthcare systems
Blockchain as a digital ledger for keeping records of digital transactions and other information, it is secure and decentralized technology. The globally growing number of digital population every day possesses a signifi…
Can large language models reason about medical questions?
Although large language models (LLMs) often produce impressive outputs, it remains unclear how they perform in real-world scenarios requiring strong reasoning skills and expert domain knowledge. We set out to investigate…
MedQAMultiple-choiceMultiple Choice Question Answering (MCQA)Prompt Engineering+3Reasoning over Hybrid Chain for Table-and-Text Open Domain Question Answering
Tabular and textual question answering requires systems to perform reasoning over heterogeneous information, considering table structure, and the connections among table and text. In this paper, we propose a ChAin-centri…
Open-Domain Question AnsweringQuestion AnsweringGranger Causal Interaction Skill Chains
Reinforcement Learning (RL) has demonstrated promising results in learning policies for complex tasks, but it often suffers from low sample efficiency and limited transferability. Hierarchical RL (HRL) methods aim to add…
reinforcement-learningReinforcement Learning (RL)