Evaluation of vector embedding models in clustering of text documents

2019-09-01 · RANLP 2019 9 · Tomasz Walkowiak, Mateusz Gniewkowski

The paper presents an evaluation of word embedding models in clustering of texts in the Polish language. Authors verified six different embedding models, starting from widely used word2vec, across fastText with character n-grams embedding, to deep learning-based ELMo and BERT. Moreover, four standardisation methods, three distance measures and four clustering methods were evaluated. The analysis was performed on two corpora of texts in Polish classified into subjects. The Adjusted Mutual Information (AMI) metric was used to verify the quality of clustering results. The performed experiments show that Skipgram models with n-grams character embedding, built on KGR10 corpus and provided by Clarin-PL, outperforms other publicly available models for Polish. Moreover, presented results suggest that Yeo{--}Johnson transformation for document vectors standardisation and Agglomerative Clustering with a cosine distance should be used for grouping of text documents.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Weight Decay 설명 없음

Residual Connection 설명 없음

Adam 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Attention 설명 없음

Explainable Graph Spectral Clustering For GloVe-like Text Embeddings

2025-08-12 · Mieczysław A. Kłopotek, Sławomir T. Wierzchoń, Bartłomiej Starosta, Piotr Borkowski 외 arxiv

In a previous paper, we proposed an introduction to the explainability of Graph Spectral Clustering results for textual documents, given that document similarity is computed as cosine similarity in term vector space. In …

From Image to Text Classification: A Novel Approach based on Clustering Word Embeddings

2017-07-25 · Andrei M. Butnaru, Radu Tudor Ionescu

In this paper, we propose a novel approach for text classification based on clustering word embeddings, inspired by the bag of visual words model, which is widely used in computer vision. After each word in a collection …

Clustering General Classification Image to text Text Categorization+3

Clustering Comparable Corpora of Russian and Ukrainian Academic Texts: Word Embeddings and Semantic Fingerprints

2016-04-18 · Andrey Kutuzov, Mikhail Kopotev, Tatyana Sviridenko, Lyubov Ivanova

We present our experience in applying distributional semantics (neural word embeddings) to the problem of representing and clustering documents in a bilingual comparable corpus. Our data is a collection of Russian and Uk…

Clustering Translation Word Embeddings

Amharic Text Clustering Using Encyclopedic Knowledge with Neural Word Embedding

2021-03-31 · Dessalew Yohannes, Yeregal Assabie

In this digital era, almost in every discipline people are using automated systems that generate information represented in document format in different natural languages. As a result, there is a growing interest towards…

Clustering Text Clustering

Explainable Graph Spectral Clustering of Text Documents

2023-08-01 · Bartłomiej Starosta, Mieczysław A. Kłopotek, Sławomir T. Wierzchoń

Spectral clustering methods are known for their ability to represent clusters of diverse shapes, densities etc. However, results of such algorithms, when applied e.g. to text documents, are hard to explain to the user, e…