PERCEIVE: A Benchmark for Personalized Emotion and Communication Behavior Understanding on Social Media
Current emotion analysis in social media is predominantly author-centric, failing to capture the subjective nature of emotional responses across diverse readers. This paradigm overlooks the crucial link between individual perception, communication behavior, and the underlying social network. To bridge this gap, we introduce PERCEIVE, a novel bilingual (English and Chinese) large-scale benchmark that, to the best of our knowledge, is the first to integrate five critical dimensions for social perception: author-created content, genuine readers' emotional feedback (derived from their comments), communication behavior, user attributes, and the social graph. This benchmark enables a paradigm shift towards truly personalized, reader-centric analysis, where different readers' emotional responses to the same content are naturally captured through their real-world interactions. By annotating emotions from reader comments and synchronously capturing communication intent, PERCEIVE provides a unique resource to model the intrinsic coupling between emotion and behavior, grounded in social context. We establish a comprehensive evaluation protocol, testing state-of-the-art methods, including large language models (LLMs) with advanced reasoning enhancement. Our findings reveal significant shortcomings in existing approaches when handling this multifaceted, user-aware task. PERCEIVE offers a foundational resource and clear direction for future research in socially-intelligent NLP, pushing models towards a more unified understanding of emotion on social media.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligence
Emotional intelligence (EI), the ability to perceive, understand, and respond appropriately to others' emotional states, is central to human communication, and increasingly important to assess as LLMs assume conversation…
Emotional IntelligenceEmotion RecognitionAI-Generated Letters from the Future: A Randomized Test of Personalized Climate Communication
We examined whether personalized, AI-generated letters from the future can increase public engagement with climate action. In a preregistered online experiment with 1,654 U.S. parents, participants were randomly assigned…
PersonaDrift: A Benchmark for Temporal Anomaly Detection in Language-Based Dementia Monitoring
People living with dementia (PLwD) often show gradual shifts in how they communicate, becoming less expressive, more repetitive, or drifting off-topic in subtle ways. While caregivers may notice these changes informally,…
Anomaly DetectionEmotional Expression in Low-Degrees-of-Freedom Robots: Assessing Perception with Reachy Mini
Emotion expression is central to human--robot interaction, yet little is known about how people interpret affect on robots with sparse, non-anthropomorphic expressive capabilities. This study examined how people perceive…
Emotion RecognitionDual-State Personalized Knowledge Tracing with Emotional Incorporation
Knowledge tracing has been widely used in online learning systems to guide the students' future learning. However, most existing KT models primarily focus on extracting abundant information from the question sets and exp…
Knowledge TracingTransfer Learning