paper-with-me

홈 › Papers

Reviewer assignment problem: A scoping review

2023-05-13 · Jelena Jovanovic, Ebrahim Bagheri

Peer review is an integral component of scientific research. The quality of peer review, and consequently the published research, depends to a large extent on the ability to recruit adequate reviewers for submitted papers. However, finding such reviewers is an increasingly difficult task due to several factors, such as the continuous increase both in the production of scientific papers and the workload of scholars. To mitigate these challenges, solutions for automated association of papers with "well matching" reviewers - the task often referred to as reviewer assignment problem (RAP) - have been the subject of research for thirty years now. Even though numerous solutions have been suggested, to our knowledge, a recent systematic synthesis of the RAP-related literature is missing. To fill this gap and support further RAP-related research, in this paper, we present a scoping review of computational approaches for addressing RAP. Following the latest methodological guidance for scoping reviews, we have collected recent literature on RAP from three databases (Scopus, Google Scholar, DBLP) and, after applying the eligibility criteria, retained 26 studies for extracting and synthesising data on several aspects of RAP research including: i) the overall framing of and approach to RAP; ii) the criteria for reviewer selection; iii) the modelling of candidate reviewers and submissions; iv) the computational methods for matching reviewers and submissions; and v) the methods for evaluating the performance of the proposed solutions. The paper summarises and discusses the findings for each of the aforementioned aspects of RAP research and suggests future research directions.

📄 PDF Abstract BibTeX arXiv:2305.07887

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mitigating Manipulation in Peer Review via Randomized Reviewer Assignments

2020-06-29 · NeurIPS 2020 12 · Steven Jecmen, Hanrui Zhang, Ryan Liu, Nihar B. Shah 외

We consider three important challenges in conference peer review: (i) reviewers maliciously attempting to get assigned to certain papers to provide positive reviews, possibly as part of quid-pro-quo arrangements with the…

Reviewer Assignment Problem: A Systematic Review of the Literature

2023-04-01 · Meltem Aksoy, Seda Yanik, Mehmet Fatih Amasyali

Appropriate reviewer assignment significantly impacts the quality of proposal evaluation, as accurate and fair reviews are contingent on their assignment to relevant reviewers. The crucial task of assigning reviewers to …

Survey

No more Reviewer #2: Subverting Automatic Paper-Reviewer Assignment using Adversarial Learning

2023-03-25 · Thorsten Eisenhofer, Erwin Quiring, Jonas Möller, Doreen Riepel 외

The number of papers submitted to academic conferences is steadily rising in many scientific disciplines. To handle this growth, systems for automatic paper-reviewer assignments are increasingly used during the reviewing…

Topic Models

exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problem

2025-02-11 · Sajad Ebrahimi, Sara Salamat, Negar Arabzadeh, Mahdi Bashari 외

The peer review process is crucial for ensuring the quality and reliability of scholarly work, yet assigning suitable reviewers remains a significant challenge. Traditional manual methods are labor-intensive and often in…

BenchmarkingDiversity

Match made by BERT? Towards Interpretable Paper-Reviewer Assignments in NLP

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Both scientific progress and individual researcher careers depend on the quality of peer review, which in turn depends on paper-reviewer matching. Surprisingly, this problem has been mostly approached simply as an automa…