paper-with-me

홈 › Papers

Extracting Affect Aggregates from Longitudinal Social Media Data with Temporal Adapters for Large Language Models

2024-09-26 · Georg Ahnert, Max Pellert, David Garcia, Markus Strohmaier

This paper proposes temporally aligned Large Language Models (LLMs) as a tool for longitudinal analysis of social media data. We fine-tune Temporal Adapters for Llama 3 8B on full timelines from a panel of British Twitter users, and extract longitudinal aggregates of emotions and attitudes with established questionnaires. We focus our analysis on the beginning of the COVID-19 pandemic that had a strong impact on public opinion and collective emotions. We validate our estimates against representative British survey data and find strong positive, significant correlations for several collective emotions. The obtained estimates are robust across multiple training seeds and prompt formulations, and in line with collective emotions extracted using a traditional classification model trained on labeled data. We demonstrate the flexibility of our method on questions of public opinion for which no pre-trained classifier is available. Our work extends the analysis of affect in LLMs to a longitudinal setting through Temporal Adapters. It enables flexible, new approaches towards the longitudinal analysis of social media data.

📄 PDF Abstract BibTeX arXiv:2409.17990

Code (1)

dess-mannheim/temporal-adapters 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Focus 설명 없음
LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

Conceptualizing Suicidal Behavior: Utilizing Explanations of Predicted Outcomes to Analyze Longitudinal Social Media Data

2023-12-13 · Van Minh Nguyen, Nasheen Nur, William Stern, Thomas Mercer 외

The COVID-19 pandemic has escalated mental health crises worldwide, with social isolation and economic instability contributing to a rise in suicidal behavior. Suicide can result from social factors such as shame, abuse,…

Language Modelling

Predicting Moments of Mood Changes Overtime from Imbalanced Social Media Data

2022-07-01 · NAACL (CLPsych) 2022 7 · Falwah Alhamed, Julia Ive, Lucia Specia

Social media data have been used in research for many years to understand users’ mental health. In this paper, using user-generated content we aim to achieve two goals: the first is detecting moments of mood change over …

Linguistic trajectories of bipolar disorder on social media

2025-09-12 · Laurin Plank, Armin Zlomuzica arxiv

Language use offers valuable insight into affective disorders such as bipolar disorder (BD), yet past research has been cross-sectional and limited in scale. Here, we demonstrate that social media records can be leverage…

Mental Health Coping Stories on Social Media: A Causal-Inference Study of Papageno Effect

2023-02-20 · Yunhao Yuan, Koustuv Saha, Barbara Keller, Erkki Tapio Isometsä 외

The Papageno effect concerns how media can play a positive role in preventing and mitigating suicidal ideation and behaviors. With the increasing ubiquity and widespread use of social media, individuals often express and…

Causal InferenceDiversity

Longitudinal Sentiment Analyses for Radicalization Research: Intertemporal Dynamics on Social Media Platforms and their Implications

2022-10-01 · Dennis Klinkhammer

This discussion paper demonstrates how longitudinal sentiment analyses can depict intertemporal dynamics on social media platforms, what challenges are inherent and how further research could benefit from a longitudinal …

Sentiment Analysis