paper-with-me

Papers

MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehension

2019-10-22 · WS 2019 11 · Adam Fisch, Alon Talmor, Robin Jia, Minjoon Seo, Eunsol Choi, Danqi Chen

We present the results of the Machine Reading for Question Answering (MRQA) 2019 shared task on evaluating the generalization capabilities of reading comprehension systems. In this task, we adapted and unified 18 distinct question answering datasets into the same format. Among them, six datasets were made available for training, six datasets were made available for development, and the final six were hidden for final evaluation. Ten teams submitted systems, which explored various ideas including data sampling, multi-task learning, adversarial training and ensembling. The best system achieved an average F1 score of 72.5 on the 12 held-out datasets, 10.7 absolute points higher than our initial baseline based on BERT.

📄 PDF Abstract BibTeX arXiv:1910.09753

Code (1)

mrqa/MRQA-Shared-Task-2019 공식 구현

Tasks

Multi-Task LearningQuestion AnsweringReading Comprehension

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

D-NET: A Pre-Training and Fine-Tuning Framework for Improving the Generalization of Machine Reading Comprehension

2019-11-01 · WS 2019 11 · Hongyu Li, Xiyuan Zhang, Yibing Liu, Yiming Zhang 외

In this paper, we introduce a simple system Baidu submitted for MRQA (Machine Reading for Question Answering) 2019 Shared Task that focused on generalization of machine reading comprehension (MRC) models. Our system is b…

Machine Reading ComprehensionMulti-Task LearningQuestion AnsweringReading Comprehension

CLER: Cross-task Learning with Expert Representation to Generalize Reading and Understanding

2019-11-01 · WS 2019 11 · Takumi Takahashi, Motoki Taniguchi, Tomoki Taniguchi, Tomoko Ohkuma

This paper describes our model for the reading comprehension task of the MRQA shared task. We propose CLER, which stands for Cross-task Learning with Expert Representation for the generalization of reading and understand…

Mixture-of-ExpertsMulti-Task LearningReading Comprehension

An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering

2019-12-04 · WS 2019 11 · Shayne Longpre, Yi Lu, Zhucheng Tu, Chris DuBois

To produce a domain-agnostic question answering model for the Machine Reading Question Answering (MRQA) 2019 Shared Task, we investigate the relative benefits of large pre-trained language models, various data sampling s…

Data AugmentationQuestion AnsweringReading ComprehensionTranslation

Clinical Reading Comprehension: A Thorough Analysis of the emrQA Dataset

2020-05-01 · ACL 2020 6 · Xiang Yue, Bernal Jimenez Gutierrez, Huan Sun

Machine reading comprehension has made great progress in recent years owing to large-scale annotated datasets. In the clinical domain, however, creating such datasets is quite difficult due to the domain expertise requir…

Machine Reading ComprehensionQuestion AnsweringReading Comprehension

emrQA-msquad: A Medical Dataset Structured with the SQuAD V2.0 Framework, Enriched with emrQA Medical Information

2024-04-18 · Jimenez Eladio, Hao Wu

Machine Reading Comprehension (MRC) holds a pivotal role in shaping Medical Question Answering Systems (QAS) and transforming the landscape of accessing and applying medical information. However, the inherent challenges …

Decision MakingMachine Reading ComprehensionMedical Question AnsweringQuestion Answering+1