paper-with-me

홈 › Papers

Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction

2024-03-26 · Masamune Kobayashi, Masato Mita, Mamoru Komachi

Large Language Models (LLMs) have been reported to outperform existing automatic evaluation metrics in some tasks, such as text summarization and machine translation. However, there has been a lack of research on LLMs as evaluators in grammatical error correction (GEC). In this study, we investigate the performance of LLMs in GEC evaluation by employing prompts designed to incorporate various evaluation criteria inspired by previous research. Our extensive experimental results demonstrate that GPT-4 achieved Kendall's rank correlation of 0.662 with human judgments, surpassing all existing methods. Furthermore, in recent GEC evaluations, we have underscored the significance of the LLMs scale and particularly emphasized the importance of fluency among evaluation criteria.

📄 PDF Abstract BibTeX arXiv:2403.17540

Code (0)

등록된 구현이 없습니다.

Tasks

Grammatical Error CorrectionMachine TranslationText Summarization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

VAIYAKARANA : A Benchmark for Automatic Grammar Correction in Bangla

2024-06-20 · Pramit Bhattacharyya, Arnab Bhattacharya

Bangla (Bengali) is the fifth most spoken language globally and, yet, the problem of automatic grammar correction in Bangla is still in its nascent stage. This is mostly due to the need for a large corpus of grammaticall…

Sentence

Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction

2024-02-18 · Yinghui Li, Shang Qin, Haojing Huang, Yangning Li 외

Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to …

Grammatical Error Correction

Recording for Eyes, Not Echoing to Ears: Contextualized Spoken-to-Written Conversion of ASR Transcripts

2024-08-19 · Jiaqing Liu, Chong Deng, Qinglin Zhang, Shilin Zhou 외

Automatic Speech Recognition (ASR) transcripts exhibit recognition errors and various spoken language phenomena such as disfluencies, ungrammatical sentences, and incomplete sentences, hence suffering from poor readabili…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)In-Context Learningspeech-recognition+1

ChatLang-8: An LLM-Based Synthetic Data Generation Framework for Grammatical Error Correction

2024-06-05 · Jeiyoon Park, Chanjun Park, Heuiseok Lim

We explore and improve the capabilities of LLMs to generate data for grammatical error correction (GEC). When merely producing parallel sentences, their patterns are too simplistic to be valuable as a corpus. To address …

Grammatical Error CorrectionSynthetic Data Generation

Grammatical Error Generation Based on Translated Fragments

2021-04-20 · NoDaLiDa 2021 5 · Eetu Sjöblom, Mathias Creutz, Teemu Vahtola

We perform neural machine translation of sentence fragments in order to create large amounts of training data for English grammatical error correction. Our method aims at simulating mistakes made by second language learn…

Grammatical Error CorrectionMachine TranslationSentenceTranslation