Multimodal Relational Tensor Network for Sentiment and Emotion Classification

2018-06-07 · WS 2018 7 · Saurav Sahay, Shachi H. Kumar, Rui Xia, Jonathan Huang, Lama Nachman

Understanding Affect from video segments has brought researchers from the language, audio and video domains together. Most of the current multimodal research in this area deals with various techniques to fuse the modalities, and mostly treat the segments of a video independently. Motivated by the work of (Zadeh et al., 2017) and (Poria et al., 2017), we present our architecture, Relational Tensor Network, where we use the inter-modal interactions within a segment (intra-segment) and also consider the sequence of segments in a video to model the inter-segment inter-modal interactions. We also generate rich representations of text and audio modalities by leveraging richer audio and linguistic context alongwith fusing fine-grained knowledge based polarity scores from text. We present the results of our model on CMU-MOSEI dataset and show that our model outperforms many baselines and state of the art methods for sentiment classification and emotion recognition.

📄 PDF Abstract BibTeX arXiv:1806.02923

Code (0)

등록된 구현이 없습니다.

Tasks

Classification Emotion Classification Emotion Recognition General Classification Sentiment AnalysisSentiment Classification

MEISD: A Multimodal Multi-Label Emotion, Intensity and Sentiment Dialogue Dataset for Emotion Recognition and Sentiment Analysis in Conversations

2020-12-01 · COLING 2020 8 · Mauajama Firdaus, Hardik Chauhan, Asif Ekbal, Pushpak Bhattacharyya

Emotion and sentiment classification in dialogues is a challenging task that has gained popularity in recent times. Humans tend to have multiple emotions with varying intensities while expressing their thoughts and feeli…

Emotion Recognition Sentiment Analysis Sentiment Classification

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

2018-05-31 · ACL 2018 7 · Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, Paul Pu Liang 외

Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal fusion. The fusion of multimodal data is the process of integrating multiple unimodal…

Emotion Recognition Multimodal Sentiment Analysis Sentiment Analysis

Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition

2024-07-31 · Jiang Li, XiaoPing Wang, Zhigang Zeng

Multimodal emotion recognition in conversation (MERC) has garnered substantial research attention recently. Existing MERC methods face several challenges: (1) they fail to fully harness direct inter-modal cues, possibly …

Emotion Recognition Emotion Recognition in Conversation Multimodal Emotion Recognition Multimodal Sentiment Analysis+1

Contrastive Clustering: Toward Unsupervised Bias Reduction for Emotion and Sentiment Classification

2021-11-14 · Jared Mowery

Background: When neural network emotion and sentiment classifiers are used in public health informatics studies, biases present in the classifiers could produce inadvertently misleading results. Objective: This study ass…

Clustering Sentiment Analysis Sentiment Classification

Advancing Multimodal Teacher Sentiment Analysis:The Large-Scale T-MED Dataset & The Effective AAM-TSA Model

2025-12-23 · Zhiyi Duan, Xiangren Wang, Hongyu Yuan, Qianli Xing arxiv

Teachers' emotional states are critical in educational scenarios, profoundly impacting teaching efficacy, student engagement, and learning achievements. However, existing studies often fail to accurately capture teachers…

Multimodal Sentiment Analysis