paper-with-me

홈 › Papers

Learning to combine Grammatical Error Corrections

2019-06-10 · WS 2019 8 · Yoav Kantor, Yoav Katz, Leshem Choshen, Edo Cohen-Karlik, Naftali Liberman, Assaf Toledo, Amir Menczel, Noam Slonim

The field of Grammatical Error Correction (GEC) has produced various systems to deal with focused phenomena or general text editing. We propose an automatic way to combine black-box systems. Our method automatically detects the strength of a system or the combination of several systems per error type, improving precision and recall while optimizing $F$ score directly. We show consistent improvement over the best standalone system in all the configurations tested. This approach also outperforms average ensembling of different RNN models with random initializations. In addition, we analyze the use of BERT for GEC - reporting promising results on this end. We also present a spellchecker created for this task which outperforms standard spellcheckers tested on the task of spellchecking. This paper describes a system submission to Building Educational Applications 2019 Shared Task: Grammatical Error Correction. Combining the output of top BEA 2019 shared task systems using our approach, currently holds the highest reported score in the open phase of the BEA 2019 shared task, improving F0.5 by 3.7 points over the best result reported.

📄 PDF Abstract BibTeX arXiv:1906.03897

Code (1)

IBM/learning-to-combine-grammatical-error-corrections 공식 구현

Tasks

Grammatical Error Correction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

System Combination via Quality Estimation for Grammatical Error Correction

2023-10-23 · Muhammad Reza Qorib, Hwee Tou Ng

Quality estimation models have been developed to assess the corrections made by grammatical error correction (GEC) models when the reference or gold-standard corrections are not available. An ideal quality estimator can …

Grammatical Error CorrectionSentence

A Hybrid System for Chinese Grammatical Error Diagnosis and Correction

2018-07-01 · WS 2018 7 · Chen Li, Junpei Zhou, Zuyi Bao, Hengyou Liu 외

This paper introduces the DM{\_}NLP team{'}s system for NLPTEA 2018 shared task of Chinese Grammatical Error Diagnosis (CGED), which can be used to detect and correct grammatical errors in texts written by Chinese as a F…

Grammatical Error CorrectionTAG

Efficient and Interpretable Grammatical Error Correction with Mixture of Experts

2024-10-30 · Muhammad Reza Qorib, Alham Fikri Aji, Hwee Tou Ng

Error type information has been widely used to improve the performance of grammatical error correction (GEC) models, whether for generating corrections, re-ranking them, or combining GEC models. Combining GEC models that…

Grammatical Error CorrectionMixture-of-ExpertsRe-Ranking

Reference-less Measure of Faithfulness for Grammatical Error Correction

2018-04-11 · NAACL 2018 6 · Leshem Choshen, Omri Abend

We propose USim, a semantic measure for Grammatical Error Correction (GEC) that measures the semantic faithfulness of the output to the source, thereby complementing existing reference-less measures (RLMs) for measuring …

Grammatical Error Correctionvalid

Type-Driven Multi-Turn Corrections for Grammatical Error Correction

2022-03-17 · Findings (ACL) 2022 5 · Shaopeng Lai, Qingyu Zhou, Jiali Zeng, Zhongli Li 외

Grammatical Error Correction (GEC) aims to automatically detect and correct grammatical errors. In this aspect, dominant models are trained by one-iteration learning while performing multiple iterations of corrections du…

Data AugmentationGrammatical Error CorrectionVocal Bursts Type Prediction