paper-with-me

Papers

Exploring Methods for Generating Feedback Comments for Writing Learning

2021-11-01 · EMNLP 2021 11 · Kazuaki Hanawa, Ryo Nagata, Kentaro Inui

The task of generating explanatory notes for language learners is known as feedback comment generation. Although various generation techniques are available, little is known about which methods are appropriate for this task. Nagata (2019) demonstrates the effectiveness of neural-retrieval-based methods in generating feedback comments for preposition use. Retrieval-based methods have limitations in that they can only output feedback comments existing in a given training data. Furthermore, feedback comments can be made on other grammatical and writing items than preposition use, which is still unaddressed. To shed light on these points, we investigate a wider range of methods for generating many feedback comments in this study. Our close analysis of the type of task leads us to investigate three different architectures for comment generation: (i) a neural-retrieval-based method as a baseline, (ii) a pointer-generator-based generation method as a neural seq2seq method, (iii) a retrieve-and-edit method, a hybrid of (i) and (ii). Intuitively, the pointer-generator should outperform neural-retrieval, and retrieve-and-edit should perform best. However, in our experiments, this expectation is completely overturned. We closely analyze the results to reveal the major causes of these counter-intuitive results and report on our findings from the experiments.

📄 PDF Abstract BibTeX

Code (1)

k-hanawa/fcg_emnlp2021 공식 구현

Tasks

Comment GenerationRetrieval

Similar Papers 제목 키워드 기반

Toward a Task of Feedback Comment Generation for Writing Learning

2019-11-01 · IJCNLP 2019 11 · Ryo Nagata

In this paper, we introduce a novel task called feedback comment generation {---} a task of automatically generating feedback comments such as a hint or an explanatory note for writing learning for non-native learners of…

Comment GenerationRetrieval

Creating Corpora for Research in Feedback Comment Generation

2020-05-01 · LREC 2020 5 · Ryo Nagata, Kentaro Inui, Shin{'}ichiro Ishikawa

In this paper, we report on datasets that we created for research in feedback comment generation {---} a task of automatically generating feedback comments such as a hint or an explanatory note for writing learning. Ther…

Comment Generation

FOXGLOVE: Understanding Goal-Oriented and Anchored Writing Feedback from Experts and LLMs on Argumentative Essays

2026-06-04 · Yijun Liu, Yifan Song, John Gallagher, Sarah Sterman 외 arxiv

While large language models (LLMs) are increasingly used to generate writing feedback, there remains no systematic comparison of LLM and expert feedback on the dimensions that writing research identifies as central to re…

LLMs can Perform Multi-Dimensional Analytic Writing Assessments: A Case Study of L2 Graduate-Level Academic English Writing

2025-02-17 · Zhengxiang Wang, Veronika Makarova, Zhi Li, Jordan Kodner 외

The paper explores the performance of LLMs in the context of multi-dimensional analytic writing assessments, i.e. their ability to provide both scores and comments based on multiple assessment criteria. Using a corpus of…

Sentence-level Feedback Generation for English Language Learners: Does Data Augmentation Help?

2022-12-18 · Shabnam Behzad, Amir Zeldes, Nathan Schneider

In this paper, we present strong baselines for the task of Feedback Comment Generation for Writing Learning. Given a sentence and an error span, the task is to generate a feedback comment explaining the error. Sentences …

Comment GenerationData AugmentationSentence