paper-with-me

홈 › Papers

Multi-task Peer-Review Score Prediction

2020-11-01 · EMNLP (sdp) 2020 11 · Jiyi Li, Ayaka Sato, Kazuya Shimura, Fumiyo Fukumoto

Automatic prediction on the peer-review aspect scores of academic papers can be a useful assistant tool for both reviewers and authors. To handle the small size of published datasets on the target aspect of scores, we propose a multi-task approach to leverage additional information from other aspects of scores for improving the performance of the target. Because one of the problems of building multi-task models is how to select the proper resources of auxiliary tasks and how to select the proper shared structures. We propose a multi-task shared structure encoding approach which automatically selects good shared network structures as well as good auxiliary resources. The experiments based on peer-review datasets show that our approach is effective and has better performance on the target scores than the single-task method and naive multi-task methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

Deep Transfer Learning Based Peer Review Aggregation and Meta-review Generation for Scientific Articles

2024-10-05 · Md. Tarek Hasan, Mohammad Nazmush Shamael, H. M. Mutasim Billah, Arifa Akter 외

Peer review is the quality assessment of a manuscript by one or more peer experts. Papers are submitted by the authors to scientific venues, and these papers must be reviewed by peers or other authors. The meta-reviewers…

ArticlesReview GenerationTransfer Learning

Assisting Decision Making in Scholarly Peer Review: A Preference Learning Perspective

2021-09-02 · Nils Dycke, Edwin Simpson, Ilia Kuznetsov, Iryna Gurevych

Peer review is the primary means of quality control in academia; as an outcome of a peer review process, program and area chairs make acceptance decisions for each paper based on the review reports and scores they receiv…

Decision MakingFairness

Eliciting Informative Text Evaluations with Large Language Models

2024-05-23 · Yuxuan Lu, Shengwei Xu, Yichi Zhang, Yuqing Kong 외

Peer prediction mechanisms motivate high-quality feedback with provable guarantees. However, current methods only apply to rather simple reports, like multiple-choice or scalar numbers. We aim to broaden these techniques…

Multiple-choicePrediction

Pre-review to Peer review: Pitfalls of Automating Reviews using Large Language Models

2025-12-14 · Akhil Pandey Akella, Harish Varma Siravuri, Shaurya Rohatgi arxiv

Large Language Models are versatile general-task solvers, and their capabilities can truly assist people with scholarly peer review as \textit{pre-review} agents, if not as fully autonomous \textit{peer-review} agents. W…

Benchmark on Peer Review Toxic Detection: A Challenging Task with a New Dataset

2025-02-01 · Man Luo, Bradley Peterson, Rafael Gan, Hari Ramalingame 외

Peer review is crucial for advancing and improving science through constructive criticism. However, toxic feedback can discourage authors and hinder scientific progress. This work explores an important but underexplored …

Sentiment Analysis