paper-with-me

Papers

Auctions and Peer Prediction for Academic Peer Review

2021-08-27 · Siddarth Srinivasan, Jamie Morgenstern

Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the overwhelming demand for reviewers due to a large volume of submissions, and (2) the lack of incentives for reviewers to participate and expend the necessary effort to provide high-quality reviews. In this work, we adopt a mechanism-design approach to propose improvements to the peer review process, tying together the paper submission and review processes and simultaneously incentivizing high-quality submissions and reviews. In the submission stage, authors participate in a VCG auction for review slots by submitting their papers along with a bid that represents their expected value for having their paper reviewed. For the reviewing stage, we propose a novel peer prediction mechanism (H-DIPP) building on recent work in the information elicitation literature, which incentivizes participating reviewers to provide honest and effortful reviews. The revenue raised in the submission stage auction is used to pay reviewers based on the quality of their reviews in the reviewing stage.

📄 PDF Abstract BibTeX arXiv:2109.00923

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

MOPRD: A multidisciplinary open peer review dataset

2022-12-09 · Jialiang Lin, Jiaxin Song, Zhangping Zhou, Yidong Chen 외

Open peer review is a growing trend in academic publications. Public access to peer review data can benefit both the academic and publishing communities. It also serves as a great support to studies on review comment gen…

Comment GenerationReview Generation

Pre-review to Peer review: Pitfalls of Automating Reviews using Large Language Models

2025-12-14 · Akhil Pandey Akella, Harish Varma Siravuri, Shaurya Rohatgi arxiv

Large Language Models are versatile general-task solvers, and their capabilities can truly assist people with scholarly peer review as \textit{pre-review} agents, if not as fully autonomous \textit{peer-review} agents. W…

Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions

2024-06-09 · Cheng Tan, Dongxin Lyu, Siyuan Li, Zhangyang Gao 외

Large Language Models (LLMs) have demonstrated wide-ranging applications across various fields and have shown significant potential in the academic peer-review process. However, existing applications are primarily limite…

Review Generation

Detecting AI-Generated Content in Academic Peer Reviews

2026-01-30 · Siyuan Shen, Kai Wang arxiv

The growing availability of large language models (LLMs) has raised questions about their role in academic peer review. This study examines the temporal emergence of AI-generated content in peer reviews by applying a det…

Impact of large language models on peer review opinions from a fine-grained perspective: Evidence from top conference proceedings in AI

2026-04-21 · Wenqing Wu, Chengzhi Zhang, Yi Zhao, Tong Bao arxiv

With the rapid advancement of Large Language Models (LLMs), the academic community has faced unprecedented disruptions, particularly in the realm of academic communication. The primary function of peer review is improvin…