paper-with-me

Papers

Fine-Grained Perspectives: Modeling Explanations with Annotator-Specific Rationales

2026-04-23 · Olufunke O. Sarumi, Charles Welch, Daniel Braun arxiv

Beyond exploring disaggregated labels for modeling perspectives, annotator rationales provide fine-grained signals of individual perspectives. In this work, we propose a framework for jointly modeling annotator-specific label prediction and corresponding explanations, fine-tuned on the annotators' provided rationales. Using a dataset with disaggregated natural language inference (NLI) annotations and annotator-provided explanations, we condition predictions on both annotator identity and demographic metadata through a representation-level User Passport mechanism. We further introduce two explainer architectures: a post-hoc prompt-based explainer and a prefixed bridge explainer that transfers annotator-conditioned classifier representations directly into a generative model. This design enables explanation generation aligned with individual annotator perspectives. Our results show that incorporating explanation modeling substantially improves predictive performance over a baseline annotator-aware classifier, with the prefixed bridge approach achieving more stable label alignment and higher semantic consistency, while the post-hoc approach yields stronger lexical similarity. These findings indicate that modeling explanations as expressions of fine-grained perspective provides a richer and more faithful representation of disagreement. The proposed approaches advance perspectivist modeling by integrating annotator-specific rationales into both predictive and generative components.

📄 PDF Abstract BibTeX arXiv:2604.21667

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language InferenceExplanation Generation

Similar Papers 제목 키워드 기반

Modeling Human Perspectives with Socio-Demographic Representations

2026-04-20 · Leixin Zhang, Cagri Coltekin arxiv

Humans often hold different perspectives on the same issues. In many NLP tasks, annotation disagreement can reflect valid subjective perspectives. Modeling annotator perspectives and understanding their relationship with…

Contrastive Learning

Corpus Considerations for Annotator Modeling and Scaling

2024-04-02 · Olufunke O. Sarumi, Béla Neuendorf, Joan Plepi, Lucie Flek 외

Recent trends in natural language processing research and annotation tasks affirm a paradigm shift from the traditional reliance on a single ground truth to a focus on individual perspectives, particularly in subjective …

Diversity

When Does Demographic Information Help? Data and Modeling Regimes for Perspective-Aware Hate Speech Detection

2026-05-26 · Weibin Cai, Reza Zafarani arxiv

Demographic information is often used to model annotator perspectives in subjective tasks such as hate speech detection, but its benefit is inconsistent: it improves performance in some settings and behaves as noise in o…

Hate Speech Detection

Beyond Majority Voting: Agreement-Based Clustering to Model Annotator Perspectives in Subjective NLP Tasks

2026-05-11 · Tadesse Destaw Belay, Ibrahim Said Ahmad, Idris Abdulmumin, Abinew Ali Ayele 외 arxiv

Disagreement in annotation is a common phenomenon in the development of NLP datasets and serves as a valuable source of insight. While majority voting remains the dominant strategy for aggregating labels, recent work has…

Emotion ClassificationHate Speech DetectionSentiment Analysis

Cost-Efficient Subjective Task Annotation and Modeling through Few-Shot Annotator Adaptation

2024-02-21 · Preni Golazizian, Alireza S. Ziabari, Ali Omrani, Morteza Dehghani

In subjective NLP tasks, where a single ground truth does not exist, the inclusion of diverse annotators becomes crucial as their unique perspectives significantly influence the annotations. In realistic scenarios, the a…