paper-with-me

Papers

SentimentArcs: A Novel Method for Self-Supervised Sentiment Analysis of Time Series Shows SOTA Transformers Can Struggle Finding Narrative Arcs

2021-10-18 · Jon Chun

SOTA Transformer and DNN short text sentiment classifiers report over 97% accuracy on narrow domains like IMDB movie reviews. Real-world performance is significantly lower because traditional models overfit benchmarks and generalize poorly to different or more open domain texts. This paper introduces SentimentArcs, a new self-supervised time series sentiment analysis methodology that addresses the two main limitations of traditional supervised sentiment analysis: limited labeled training datasets and poor generalization. A large ensemble of diverse models provides a synthetic ground truth for self-supervised learning. Novel metrics jointly optimize an exhaustive search across every possible corpus:model combination. The joint optimization over both the corpus and model solves the generalization problem. Simple visualizations exploit the temporal structure in narratives so domain experts can quickly spot trends, identify key features, and note anomalies over hundreds of arcs and millions of data points. To our knowledge, this is the first self-supervised method for time series sentiment analysis and the largest survey directly comparing real-world model performance on long-form narratives.

📄 PDF Abstract BibTeX arXiv:2110.09454

Code (1)

jon-chun/sentimentarcs_notebooks 공식 구현

Tasks

Self-Supervised LearningSentiment AnalysisTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Using Self-Organizing Maps for Sentiment Analysis

2013-09-16 · Anuj Sharma, Shubhamoy Dey

Web 2.0 services have enabled people to express their opinions, experience and feelings in the form of user-generated content. Sentiment analysis or opinion mining involves identifying, classifying and aggregating opinio…

ClassificationGeneral ClassificationOpinion MiningQuantization+1

Unsupervised Self-Training for Sentiment Analysis of Code-Switched Data

2021-03-27 · NAACL (CALCS) 2021 6 · Akshat Gupta, Sargam Menghani, Sai Krishna Rallabandi, Alan W Black

Sentiment analysis is an important task in understanding social media content like customer reviews, Twitter and Facebook feeds etc. In multilingual communities around the world, a large amount of social media text is ch…

Sentiment Analysis

Weakly-Supervised Aspect-Based Sentiment Analysis via Joint Aspect-Sentiment Topic Embedding

2020-10-13 · EMNLP 2020 11 · Jiaxin Huang, Yu Meng, Fang Guo, Heng Ji 외

Aspect-based sentiment analysis of review texts is of great value for understanding user feedback in a fine-grained manner. It has in general two sub-tasks: (i) extracting aspects from each review, and (ii) classifying a…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Sentiment AnalysisSentiment Classification+1

Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa

2022-07-06 · Tianyu Zhao, Junping Du, Zhe Xue, Ang Li 외

Text sentiment analysis, also known as opinion mining, is research on the calculation of people's views, evaluations, attitude and emotions expressed by entities. Text sentiment analysis can be divided into text-level se…

Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Language ModellingMulti-Task Learning+3

Making sense of electrical vehicle discussions using sentiment analysis on closely related news and user comments

2021-12-23 · Xuan Jiang, Josh Everts

We used a token-wise and document-wise sentiment analysis using both unsupervised and supervised models applied to both news and user reviews dataset. And our token-wise sentiment analysis found a statistically significa…

Sentiment Analysis