Emotions are Subtle: Learning Sentiment Based Text Representations Using Contrastive Learning
Contrastive learning techniques have been widely used in the field of computer vision as a means of augmenting datasets. In this paper, we extend the use of these contrastive learning embeddings to sentiment analysis tasks and demonstrate that fine-tuning on these embeddings provides an improvement over fine-tuning on BERT-based embeddings to achieve higher benchmarks on the task of sentiment analysis when evaluated on the DynaSent dataset. We also explore how our fine-tuned models perform on cross-domain benchmark datasets. Additionally, we explore upsampling techniques to achieve a more balanced class distribution to make further improvements on our benchmark tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Sentiment Analysis with Biofeedback Data
Humans frequently are able to read and interpret emotions of others by directly taking verbal and non-verbal signals in human-to-human communication into account or to infer or even experience emotions from mediated stor…
Emotion RecognitionSentenceSentiment AnalysisBeyond Simple Fusion: Adaptive Gated Fusion for Robust Multimodal Sentiment Analysis
Multimodal sentiment analysis (MSA) leverages information fusion from diverse modalities (e.g., text, audio, visual) to enhance sentiment prediction. However, simple fusion techniques often fail to account for variations…
Multimodal Sentiment AnalysisAn Enhanced Dual Transformer Contrastive Network for Multimodal Sentiment Analysis
Multimodal Sentiment Analysis (MSA) seeks to understand human emotions by jointly analyzing data from multiple modalities typically text and images offering a richer and more accurate interpretation than unimodal approac…
Multimodal Sentiment AnalysisRepresentation LearningContrastive LearningRetrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning
We present a novel retrofitting method to induce emotion aspects into pre-trained language models (PLMs) such as BERT and RoBERTa. Our method updates pre-trained network weights using contrastive learning so that the tex…
Contrastive LearningFew-Shot LearningRetrievalSarcasm Detection+1Emotions are Universal: Learning Sentiment Based Representations of Resource-Poor Languages using Siamese Networks
Machine learning approaches in sentiment analysis principally rely on the abundance of resources. To limit this dependence, we propose a novel method called Siamese Network Architecture for Sentiment Analysis (SNASA) to …
SentenceSentiment Analysis