paper-with-me

Papers

Disparities in Peer Review Tone and the Role of Reviewer Anonymity

2025-07-19 · Maria Sahakyan, Bedoor AlShebli arxiv

The peer review process is often regarded as the gatekeeper of scientific integrity, yet increasing evidence suggests that it is not immune to bias. Although structural inequities in peer review have been widely debated, much less attention has been paid to the subtle ways in which language itself may reinforce disparities. This study undertakes one of the most comprehensive linguistic analyses of peer review to date, examining more than 80,000 reviews in two major journals. Using natural language processing and large-scale statistical modeling, it uncovers how review tone, sentiment, and supportive language vary across author demographics, including gender, race, and institutional affiliation. Using a data set that includes both anonymous and signed reviews, this research also reveals how the disclosure of reviewer identity shapes the language of evaluation. The findings not only expose hidden biases in peer feedback, but also challenge conventional assumptions about anonymity's role in fairness. As academic publishing grapples with reform, these insights raise critical questions about how review policies shape career trajectories and scientific progress.

📄 PDF Abstract BibTeX arXiv:2507.14741

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Insights from the ICLR Peer Review and Rebuttal Process

2025-11-19 · Amir Hossein Kargaran, Nafiseh Nikeghbal, Jing Yang, Nedjma Ousidhoum arxiv

Peer review is a cornerstone of scientific publishing, including at premier machine learning conferences such as ICLR. As submission volumes increase, understanding the nature and dynamics of the review process is crucia…

ReviewerToo: Should AI Join The Program Committee? A Look At The Future of Peer Review

2025-10-09 · Gaurav Sahu, Hugo Larochelle, Laurent Charlin, Christopher Pal arxiv

Peer review is the cornerstone of scientific publishing, yet it suffers from inconsistencies, reviewer subjectivity, and scalability challenges. We introduce ReviewerToo, a modular framework for studying and deploying AI…

Causal Effect of Group Diversity on Redundancy and Coverage in Peer-Reviewing

2024-11-18 · Navita Goyal, Ivan Stelmakh, Nihar Shah, Hal Daumé III

A large host of scientific journals and conferences solicit peer reviews from multiple reviewers for the same submission, aiming to gather a broader range of perspectives and mitigate individual biases. In this work, we …

Diversity

DeepSentiPeer: Harnessing Sentiment in Review Texts to Recommend Peer Review Decisions

2019-07-01 · ACL 2019 7 · Tirthankar Ghosal, Rajeev Verma, Asif Ekbal, Pushpak Bhattacharyya

Automatically validating a research artefact is one of the frontiers in Artificial Intelligence (AI) that directly brings it close to competing with human intellect and intuition. Although criticised sometimes, the exist…

A Large Scale Randomized Controlled Trial on Herding in Peer-Review Discussions

2020-11-30 · Ivan Stelmakh, Charvi Rastogi, Nihar B. Shah, Aarti Singh 외

Peer review is the backbone of academia and humans constitute a cornerstone of this process, being responsible for reviewing papers and making the final acceptance/rejection decisions. Given that human decision making is…

Decision Making