paper-with-me

홈 › Papers

Ask, Answer, and Detect: Role-Playing LLMs for Personality Detection with Question-Conditioned Mixture-of-Experts

2025-12-09 · Yifan Lyu, Liang Zhang arxiv

Understanding human personality is crucial for web applications such as personalized recommendation and mental health assessment. Existing studies on personality detection predominantly adopt a "posts -> user vector -> labels" modeling paradigm, which encodes social media posts into user representations for predicting personality labels (e.g., MBTI labels). While recent advances in large language models (LLMs) have improved text encoding capacities, these approaches remain constrained by limited supervision signals due to label scarcity, and under-specified semantic mappings between user language and abstract psychological constructs. We address these challenges by proposing ROME, a novel framework that explicitly injects psychological knowledge into personality detection. Inspired by standardized self-assessment tests, ROME leverages LLMs' role-play capability to simulate user responses to validated psychometric questionnaires. These generated question-level answers transform free-form user posts into interpretable, questionnaire-grounded evidence linking linguistic cues to personality labels, thereby providing rich intermediate supervision to mitigate label scarcity while offering a semantic reasoning chain that guides and simplifies the text-to-personality mapping learning. A question-conditioned Mixture-of-Experts module then jointly routes over post and question representations, learning to answer questionnaire items under explicit supervision. The predicted answers are summarized into an interpretable answer vector and fused with the user representation for final prediction within a multi-task learning framework, where question answering serves as a powerful auxiliary task for personality detection. Extensive experiments on two real-world datasets demonstrate that ROME consistently outperforms state-of-the-art baselines, achieving improvements (15.41% on Kaggle dataset).

📄 PDF Abstract BibTeX arXiv:2512.08814

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task LearningQuestion Answering

Similar Papers 제목 키워드 기반

PsyPlay: Personality-Infused Role-Playing Conversational Agents

2025-02-06 · Tao Yang, Yuhua Zhu, Xiaojun Quan, Cong Liu 외

The current research on Role-Playing Conversational Agents (RPCAs) with Large Language Models (LLMs) primarily focuses on imitating specific speaking styles and utilizing character backgrounds, neglecting the depiction o…

Dialogue Generation

ToMATO: Verbalizing the Mental States of Role-Playing LLMs for Benchmarking Theory of Mind

2025-01-15 · Kazutoshi Shinoda, Nobukatsu Hojo, Kyosuke Nishida, Saki Mizuno 외

Existing Theory of Mind (ToM) benchmarks diverge from real-world scenarios in three aspects: 1) they assess a limited range of mental states such as beliefs, 2) false beliefs are not comprehensively explored, and 3) the …

BenchmarkingMultiple-choice

Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data

2024-06-27 · Yiting Ran, Xintao Wang, Rui Xu, Xinfeng Yuan 외

Role-playing agents (RPA) have been a popular application area for large language models (LLMs), attracting significant interest from both industry and academia.While existing RPAs well portray the characters' knowledge …

Orca: Enhancing Role-Playing Abilities of Large Language Models by Integrating Personality Traits

2024-11-15 · Yuxuan Huang

Large language models has catalyzed the development of personalized dialogue systems, numerous role-playing conversational agents have emerged. While previous research predominantly focused on enhancing the model's capab…

Rethinking Role-Playing Evaluation: Anonymous Benchmarking and a Systematic Study of Personality Effects

2026-03-04 · Ji-Lun Peng, Yun-Nung Chen arxiv

Large Language Models (LLMs) have shown remarkable potential in developing role-playing agents (RPAs). However, current evaluation frameworks rely heavily on well-known fictional characters, raising a critical concern: m…