A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding
Users of medical question answering systems often submit long and detailed questions, making it hard to achieve high recall in answer retrieval. To alleviate this problem, we propose a novel Multi-Task Learning (MTL) method with data augmentation for medical question understanding. We first establish an equivalence between the tasks of question summarization and Recognizing Question Entailment (RQE) using their definitions in the medical domain. Based on this equivalence, we propose a data augmentation algorithm to use just one dataset to optimize for both tasks, with a weighted MTL loss. We introduce gradually soft parameter-sharing: a constraint for decoder parameters to be close, that is gradually loosened as we move to the highest layer. We show through ablation studies that our proposed novelties improve performance. Our method outperforms existing MTL methods across 4 datasets of medical question pairs, in ROUGE scores, RQE accuracy and human evaluation. Finally, we show that our method fares better than single-task learning under 4 low-resource settings.
Code (1)
Tasks
Data AugmentationDecoderMedical Question AnsweringMulti-Task LearningQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
Immersive Language Exploration with Object Recognition and Augmented Reality
The use of Augmented Reality (AR) in teaching and learning contexts for language is still young. The ideas are endless, the concrete educational offers available emerge only gradually. Educational opportunities that were…
ObjectObject RecognitionPlanning-Augmented Sampling with Early Guidance for High-Reward Discovery
Generative Flow Networks (GFlowNets) enable structured generation with inherent diversity, but existing sampling strategies often rely on weak guided exploration, slowing early discovery of high-reward candidates. In tas…
Active Sample Selection and Correction Propagation on a Gradually-Augmented Graph
When data have a complex manifold structure or the characteristics of data evolve over time, it is unrealistic to expect a graph-based semi-supervised learning method to achieve flawless classification given a small numb…
General ClassificationConsolidated Adaptive T-soft Update for Deep Reinforcement Learning
Demand for deep reinforcement learning (DRL) is gradually increased to enable robots to perform complex tasks, while DRL is known to be unstable. As a technique to stabilize its learning, a target network that slowly and…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Generalization in Reinforcement Learning by Soft Data Augmentation
Extensive efforts have been made to improve the generalization ability of Reinforcement Learning (RL) methods via domain randomization and data augmentation. However, as more factors of variation are introduced during tr…
Data Augmentationreinforcement-learningReinforcement LearningReinforcement Learning (RL)