Comparative study of LSA vs Word2vec embeddings in small corpora: a case study in dreams database
Word embeddings have been extensively studied in large text datasets. However, only a few studies analyze semantic representations of small corpora, particularly relevant in single-person text production studies. In the present paper, we compare Skip-gram and LSA capabilities in this scenario, and we test both techniques to extract relevant semantic patterns in single-series dreams reports. LSA showed better performance than Skip-gram in small size training corpus in two semantic tests. As a study case, we show that LSA can capture relevant words associations in dream reports series, even in cases of small number of dreams or low-frequency words. We propose that LSA can be used to explore words associations in dreams reports, which could bring new insight into this classic research area of psychology
Code (0)
등록된 구현이 없습니다.
Tasks
Word EmbeddingsSimilar Papers 제목 키워드 기반
From the New World of Word Embeddings: A Comparative Study of Small-World Lexico-Semantic Networks in LLMs
Lexico-semantic networks represent words as nodes and their semantic relatedness as edges. While such networks are traditionally constructed using embeddings from encoder-based models or static vectors, embeddings from d…
DecoderWord EmbeddingsA Comparative Study of Transformers on Word Sense Disambiguation
Recent years of research in Natural Language Processing (NLP) have witnessed dramatic growth in training large models for generating context-aware language representations. In this regard, numerous NLP systems have lever…
Word EmbeddingsWord Sense DisambiguationBringing Order to Neural Word Embeddings with Embeddings Augmented by Random Permutations (EARP)
Word order is clearly a vital part of human language, but it has been used comparatively lightly in distributional vector models. This paper presents a new method for incorporating word order information into word vector…
RetrievalWord EmbeddingsA Comparative Study on Word Embeddings and Social NLP Tasks
In recent years, gray social media platforms, those with a loose moderation policy on cyberbullying, have been attracting more users. Recently, data collected from these types of platforms have been used to pre-train wor…
Word EmbeddingsTextEssence: A Tool for Interactive Analysis of Semantic Shifts Between Corpora
Embeddings of words and concepts capture syntactic and semantic regularities of language; however, they have seen limited use as tools to study characteristics of different corpora and how they relate to one another. We …