paper-with-me

홈 › Papers

Reviewing the Reviewer: Elevating Peer Review Quality through LLM-Guided Feedback

2026-01-17 · Sukannya Purkayastha, Qile Wan, Anne Lauscher, Lizhen Qu, Iryna Gurevych arxiv

Peer review is central to scientific quality, yet reliance on simple heuristics -- lazy thinking -- has lowered standards. Prior work treats lazy thinking detection as a single-label task, but review segments may exhibit multiple issues, including broader clarity problems, or specificity issues. Turning detection into actionable improvements requires guideline-aware feedback, which is currently missing. We introduce an LLM-driven framework that decomposes reviews into argumentative segments, identifies issues via a neurosymbolic module combining LLM features with traditional classifiers, and generates targeted feedback using issue-specific templates refined by a genetic algorithm. Experiments show our method outperforms zero-shot LLM baselines and improves review quality by up to 92.4\%. We also release LazyReviewPlus, a dataset of 1,309 sentences labeled for lazy thinking and specificity.

📄 PDF Abstract BibTeX arXiv:2602.10118

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Auctions and Peer Prediction for Academic Peer Review

2021-08-27 · Siddarth Srinivasan, Jamie Morgenstern

Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the over…

Prediction

Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards

2025-05-08 · Jaeho Kim, Yunseok Lee, Seulki Lee

The peer review process in major artificial intelligence (AI) conferences faces unprecedented challenges with the surge of paper submissions (exceeding 10,000 submissions per venue), accompanied by growing concerns over …

Position

What happens when reviewers receive AI feedback in their reviews?

2026-02-14 · Shiping Chen, Shu Zhong, Duncan P. Brumby, Anna L. Cox arxiv

AI is reshaping academic research, yet its role in peer review remains polarising and contentious. Advocates see its potential to reduce reviewer burden and improve quality, while critics warn of risks to fairness, accou…

Combating Collusion Rings is Hard but Possible

2021-12-14 · Niclas Boehmer, Robert Bredereck, André Nichterlein

A recent report of Littmann [Commun. ACM '21] outlines the existence and the fatal impact of collusion rings in academic peer reviewing. We introduce and analyze the problem Cycle-Free Reviewing that aims at finding a re…

Double blind vs. open review: an evolutionary game logit-simulating the behavior of authors and reviewers

2020-11-16 · Mantas Radzvilas, Francesco De Pretis, William Peden, Daniele Tortoli 외

Despite the tremendous successes of science in providing knowledge and technologies, the Replication Crisis has highlighted that scientific institutions have much room for improvement. Peer-review is one target of critic…