Multi-label Multi-task Deep Learning for Behavioral Coding
We propose a methodology for estimating human behaviors in psychotherapy sessions using mutli-label and multi-task learning paradigms. We discuss the problem of behavioral coding in which data of human interactions is the annotated with labels to describe relevant human behaviors of interest. We describe two related, yet distinct, corpora consisting of therapist client interactions in psychotherapy sessions. We experimentally compare the proposed learning approaches for estimating behaviors of interest in these datasets. Specifically, we compare single and multiple label learning approaches, single and multiple task learning approaches, and evaluate the performance of these approaches when incorporating turn context. We demonstrate the prediction performance gains which can be achieved by using the proposed paradigms and discuss the insights these models provide into these complex interactions.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningMulti-Task LearningSimilar Papers 제목 키워드 기반
Self-supervised pretraining of vision transformers for animal behavioral analysis and neural encoding
The brain can only be fully understood through the lens of the behavior it generates -- a guiding principle in modern neuroscience research that nevertheless presents significant technical challenges. Many studies captur…
Action SegmentationContrastive LearningPose EstimationWhen Better Codebooks Are Not Enough: Predictive Performance and Behavioral Reliability in LLM Political Event Coding
High accuracy does not necessarily make an LLM a faithful coder. This issue matters because many social-science studies rely on expert-written codebooks to turn text into structured data. We study this problem in politic…
Relation ClassificationLearning Disentangled Behavior Embeddings
To understand the relationship between behavior and neural activity, experiments in neuroscience often include an animal performing a repeated behavior such as a motor task. Recent progress in computer vision and deep le…
BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting
Multi-view video recordings are increasingly used to capture the 3D movements of animals in experimental settings, yet extracting rich 3D representations from these recordings remains challenging. Supervised pose estimat…
Novel View Synthesis3D ReconstructionPose EstimationLearnable latent embeddings for joint behavioral and neural analysis
Mapping behavioral actions to neural activity is a fundamental goal of neuroscience. As our ability to record large neural and behavioral data increases, there is growing interest in modeling neural dynamics during adapt…