paper-with-me

홈 › Papers

The Specificity and Helpfulness of Peer-to-Peer Feedback in Higher Education

2022-07-01 · NAACL (BEA) 2022 7 · Roman Rietsche, Andrew Caines, Cornelius Schramm, Dominik Pfütze, Paula Buttery

With the growth of online learning through MOOCs and other educational applications, it has become increasingly difficult for course providers to offer personalized feedback to students. Therefore asking students to provide feedback to each other has become one way to support learning. This peer-to-peer feedback has become increasingly important whether in MOOCs to provide feedback to thousands of students or in large-scale classes at universities. One of the challenges when allowing peer-to-peer feedback is that the feedback should be perceived as helpful, and an import factor determining helpfulness is how specific the feedback is. However, in classes including thousands of students, instructors do not have the resources to check the specificity of every piece of feedback between students. Therefore, we present an automatic classification model to measure sentence specificity in written feedback. The model was trained and tested on student feedback texts written in German where sentences have been labelled as general or specific. We find that we can automatically classify the sentences with an accuracy of 76.7% using a conventional feature-based approach, whereas transfer learning with BERT for German gives a classification accuracy of 81.1%. However, the feature-based approach comes with lower computational costs and preserves human interpretability of the coefficients. In addition we show that specificity of sentences in feedback texts has a weak positive correlation with perceptions of helpfulness. This indicates that specificity is one of the ingredients of good feedback, and invites further investigation.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

SentenceSpecificityTransfer Learning

Similar Papers 제목 키워드 기반

Automated Focused Feedback Generation for Scientific Writing Assistance

2024-05-30 · Eric Chamoun, Michael Schlichktrull, Andreas Vlachos

Scientific writing is a challenging task, particularly for novice researchers who often rely on feedback from experienced peers. Recent work has primarily focused on improving surface form and style rather than manuscrip…

Reading ComprehensionSpecificity

Level Up Peer Review in Education: Investigating genAI-driven Gamification system and its influence on Peer Feedback Effectiveness

2025-04-03 · Rafal Wlodarski, Leonardo da Silva Sousa, Allison Connell Pensky

In software engineering (SE), the ability to review code and critique designs is essential for professional practice. However, these skills are rarely emphasized in formal education, and peer feedback quality and engagem…

Specificity

A Corpus for Suggestion Mining of German Peer Feedback

2022-06-01 · LREC 2022 6 · Dominik Pfütze, Eva Ritz, Julius Janda, Roman Rietsche

Peer feedback in online education becomes increasingly important to meet the demand for feedback in large scale classes, such as e.g. Massive Open Online Courses (MOOCs). However, students are often not experts in how to…

Dependency ParsingSentiment AnalysisSuggestion mining

Journal Impact Factor and Peer Review Thoroughness and Helpfulness: A Supervised Machine Learning Study

2022-07-20 · Anna Severin, Michaela Strinzel, Matthias Egger, Tiago Barros 외

The journal impact factor (JIF) is often equated with journal quality and the quality of the peer review of the papers submitted to the journal. We examined the association between the content of peer review and JIF by a…

The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors

2025-08-31 · Abdelrahman Sadallah, Tim Baumgärtner, Iryna Gurevych, Ted Briscoe arxiv

Providing constructive feedback to paper authors is a core component of peer review. With reviewers increasingly having less time to perform reviews, automated support systems are required to ensure high reviewing qualit…