Clustering Word Embeddings with Self-Organizing Maps. Application on LaRoSeDa -- A Large Romanian Sentiment Data Set

2021-01-11 · Anca Maria Tache, Mihaela Gaman, Radu Tudor Ionescu

Romanian is one of the understudied languages in computational linguistics, with few resources available for the development of natural language processing tools. In this paper, we introduce LaRoSeDa, a Large Romanian Sentiment Data Set, which is composed of 15,000 positive and negative reviews collected from one of the largest Romanian e-commerce platforms. We employ two sentiment classification methods as baselines for our new data set, one based on low-level features (character n-grams) and one based on high-level features (bag-of-word-embeddings generated by clustering word embeddings with k-means). As an additional contribution, we replace the k-means clustering algorithm with self-organizing maps (SOMs), obtaining better results because the generated clusters of word embeddings are closer to the Zipf's law distribution, which is known to govern natural language. We also demonstrate the generalization capacity of using SOMs for the clustering of word embeddings on another recently-introduced Romanian data set, for text categorization by topic.

📄 PDF Abstract BibTeX arXiv:2101.04197

Code (1)

ancatache/LaRoSeDa 공식 구현

Tasks

ClusteringSentiment AnalysisSentiment ClassificationText CategorizationWord Embeddings

Methods 이 논문이 사용한 방법론

k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…

Clustering Word Embeddings with Self-Organizing Maps. Application on LaRoSeDa - A Large Romanian Sentiment Data Set

2021-04-01 · EACL 2021 2 · Anca Tache, Gaman Mihaela, Radu Tudor Ionescu

Clustering Sentiment Analysis Sentiment Classification Text Categorization+1

An Ensemble of Adaptive Neuro-Fuzzy Kohonen Networks for Online Data Stream Fuzzy Clustering

2016-10-20 · Zhengbing Hu, Yevgeniy V. Bodyanskiy, Oleksii K. Tyshchenko, Olena O. Boiko

A new approach to data stream clustering with the help of an ensemble of adaptive neuro-fuzzy systems is proposed. The proposed ensemble is formed with adaptive neuro-fuzzy self-organizing Kohonen maps in a parallel proc…

Clustering

DPSOM: Deep Probabilistic Clustering with Self-Organizing Maps

2019-10-03 · Laura Manduchi, Matthias Hüser, Julia Vogt, Gunnar Rätsch 외

Generating interpretable visualizations from complex data is a common problem in many applications. Two key ingredients for tackling this issue are clustering and representation learning. However, current methods do not …

Clustering Deep Clustering Representation Learning Time Series+3

Automated and Weighted Self-Organizing Time Maps

2013-11-22 · Peter Sarlin

This paper proposes schemes for automated and weighted Self-Organizing Time Maps (SOTMs). The SOTM provides means for a visual approach to evolutionary clustering, which aims at producing a sequence of clustering solutio…

Clustering

Variational pSOM: Deep Probabilistic Clustering with Self-Organizing Maps

2019-09-25 · Laura Manduchi, Matthias Hüser, Gunnar Rätsch, Vincent Fortuin

Generating visualizations and interpretations from high-dimensional data is a common problem in many fields. Two key approaches for tackling this problem are clustering and representation learning. There are very perfor…

Clustering Deep Clustering Representation Learning Time Series+1