paper-with-me

Papers

Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards

2025-05-08 · Jaeho Kim, Yunseok Lee, Seulki Lee

The peer review process in major artificial intelligence (AI) conferences faces unprecedented challenges with the surge of paper submissions (exceeding 10,000 submissions per venue), accompanied by growing concerns over review quality and reviewer responsibility. This position paper argues for the need to transform the traditional one-way review system into a bi-directional feedback loop where authors evaluate review quality and reviewers earn formal accreditation, creating an accountability framework that promotes a sustainable, high-quality peer review system. The current review system can be viewed as an interaction between three parties: the authors, reviewers, and system (i.e., conference), where we posit that all three parties share responsibility for the current problems. However, issues with authors can only be addressed through policy enforcement and detection tools, and ethical concerns can only be corrected through self-reflection. As such, this paper focuses on reforming reviewer accountability with systematic rewards through two key mechanisms: (1) a two-stage bi-directional review system that allows authors to evaluate reviews while minimizing retaliatory behavior, (2)a systematic reviewer reward system that incentivizes quality reviewing. We ask for the community's strong interest in these problems and the reforms that are needed to enhance the peer review process.

📄 PDF Abstract BibTeX arXiv:2505.04966

Code (0)

등록된 구현이 없습니다.

Tasks

Position

Similar Papers 제목 키워드 기반

Position: The Current AI Conference Model is Unsustainable! Diagnosing the Crisis of Centralized AI Conference

2025-08-06 · Nuo Chen, Moming Duan, Andre Huikai Lin, Qian Wang 외 arxiv

Artificial Intelligence (AI) conferences are essential for advancing research, sharing knowledge, and fostering academic community. However, their rapid expansion has rendered the centralized conference model increasingl…

Stop Automating Peer Review Without Rigorous Evaluation

2026-05-04 · Joachim Baumann, Jiaxin Pei, Sanmi Koyejo, Dirk Hovy arxiv

Large language models offer a tempting solution to address the peer review crisis. This position paper argues that today's AI systems should not be used to produce paper reviews. We ground this position in an empirical c…

Paper Copilot Position: The Artificial Intelligence and Machine Learning Community Should Adopt a More Transparent and Regulated Peer Review Process

2025-02-02 · Jing Yang

The rapid growth of submissions to top-tier Artificial Intelligence (AI) and Machine Learning (ML) conferences has prompted many venues to transition from closed to open review platforms. Some have fully embraced open pe…

Position

On Strategyproof Conference Peer Review

2018-06-16 · Yichong Xu, Han Zhao, Xiaofei Shi, Jeremy Zhang 외

We consider peer review in a conference setting where there is typically an overlap between the set of reviewers and the set of authors. This overlap can incentivize strategic reviews to influence the final ranking of on…

Automatic Analysis of Substantiation in Scientific Peer Reviews

2023-11-20 · Yanzhu Guo, Guokan Shang, Virgile Rennard, Michalis Vazirgiannis 외

With the increasing amount of problematic peer reviews in top AI conferences, the community is urgently in need of automatic quality control measures. In this paper, we restrict our attention to substantiation -- one pop…

Argument Mining