paper-with-me

Papers

Group Fairness in Peer Review

2024-10-04 · NeurIPS 2023 11 · Haris Aziz, Evi Micha, Nisarg Shah

Large conferences such as NeurIPS and AAAI serve as crossroads of various AI fields, since they attract submissions from a vast number of communities. However, in some cases, this has resulted in a poor reviewing experience for some communities, whose submissions get assigned to less qualified reviewers outside of their communities. An often-advocated solution is to break up any such large conference into smaller conferences, but this can lead to isolation of communities and harm interdisciplinary research. We tackle this challenge by introducing a notion of group fairness, called the core, which requires that every possible community (subset of researchers) to be treated in a way that prevents them from unilaterally benefiting by withdrawing from a large conference. We study a simple peer review model, prove that it always admits a reviewing assignment in the core, and design an efficient algorithm to find one such assignment. We use real data from CVPR and ICLR conferences to compare our algorithm to existing reviewing assignment algorithms on a number of metrics.

📄 PDF Abstract BibTeX arXiv:2410.03474

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Investigating Fairness Disparities in Peer Review: A Language Model Enhanced Approach

2022-11-07 · Jiayao Zhang, Hongming Zhang, Zhun Deng, Dan Roth

Double-blind peer review mechanism has become the skeleton of academic research across multiple disciplines including computer science, yet several studies have questioned the quality of peer reviews and raised concerns …

FairnessLanguage ModelingLanguage ModellingReview Generation

PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review

2018-06-16 · Ivan Stelmakh, Nihar B. Shah, Aarti Singh

We consider the problem of automated assignment of papers to reviewers in conference peer review, with a focus on fairness and statistical accuracy. Our fairness objective is to maximize the review quality of the most di…

Fairness

From Bias to Balance: Fairness-Aware Paper Recommendation for Equitable Peer Review

2026-02-25 · Uttamasha Anjally Oyshi, Susan Gauch arxiv

Despite frequent double-blind review, systemic biases related to author demographics still disadvantage underrepresented groups. We start from a simple hypothesis: if a post-review recommender is trained with an explicit…

Peerispect: Claim Verification in Scientific Peer Reviews

2026-04-19 · Ali Ghorbanpour, Soroush Sadeghian, Alireza Daghighfarsoodeh, Sajad Ebrahimi 외 arxiv

Peer review is central to scientific publishing, yet reviewers frequently include claims that are subjective, rhetorical, or misaligned with the submitted work. Assessing whether review statements are factual and verifia…

Natural Language InferenceInformation Retrieval

Assisting Decision Making in Scholarly Peer Review: A Preference Learning Perspective

2021-09-02 · Nils Dycke, Edwin Simpson, Ilia Kuznetsov, Iryna Gurevych

Peer review is the primary means of quality control in academia; as an outcome of a peer review process, program and area chairs make acceptance decisions for each paper based on the review reports and scores they receiv…

Decision MakingFairness