Tradeoffs in Preventing Manipulation in Paper Bidding for Reviewer Assignment
Many conferences rely on paper bidding as a key component of their reviewer assignment procedure. These bids are then taken into account when assigning reviewers to help ensure that each reviewer is assigned to suitable papers. However, despite the benefits of using bids, reliance on paper bidding can allow malicious reviewers to manipulate the paper assignment for unethical purposes (e.g., getting assigned to a friend's paper). Several different approaches to preventing this manipulation have been proposed and deployed. In this paper, we enumerate certain desirable properties that algorithms for addressing bid manipulation should satisfy. We then offer a high-level analysis of various approaches along with directions for future investigation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to Collusions
In the peer review process of top-tier machine learning (ML) and artificial intelligence (AI) conferences, reviewers are assigned to papers through automated methods. These assignment algorithms consider two main factors…
Text Matchingtext similarityMaking Paper Reviewing Robust to Bid Manipulation Attacks
Most computer science conferences rely on paper bidding to assign reviewers to papers. Although paper bidding enables high-quality assignments in days of unprecedented submission numbers, it also opens the door for disho…
CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review
Recent reports during the AAAI-27 review cycle highlight the risk of reviewers coordinating bids for reciprocal assignment advantage. Prior work treats bidding, reviewer assignment, and review manipulation as separate st…
On the Detection of Reviewer-Author Collusion Rings From Paper Bidding
A major threat to the peer-review systems of computer science conferences is the existence of "collusion rings" between reviewers. In such collusion rings, reviewers who have also submitted their own papers to the confer…
Fraud Detectiontext similarityA Dataset on Malicious Paper Bidding in Peer Review
In conference peer review, reviewers are often asked to provide "bids" on each submitted paper that express their interest in reviewing that paper. A paper assignment algorithm then uses these bids (along with other data…
Descriptive