paper-with-me

홈 › Papers

Semantic Word Clouds with Background Corpus Normalization and t-distributed Stochastic Neighbor Embedding

2017-08-11 · Erich Schubert, Andreas Spitz, Michael Weiler, Johanna Geiß, Michael Gertz

Many word clouds provide no semantics to the word placement, but use a random layout optimized solely for aesthetic purposes. We propose a novel approach to model word significance and word affinity within a document, and in comparison to a large background corpus. We demonstrate its usefulness for generating more meaningful word clouds as a visual summary of a given document. We then select keywords based on their significance and construct the word cloud based on the derived affinity. Based on a modified t-distributed stochastic neighbor embedding (t-SNE), we generate a semantic word placement. For words that cooccur significantly, we include edges, and cluster the words according to their cooccurrence. For this we designed a scalable and memory-efficient sketch-based approach usable on commodity hardware to aggregate the required corpus statistics needed for normalization, and for identifying keywords as well as significant cooccurences. We empirically validate our approch using a large Wikipedia corpus.

📄 PDF Abstract BibTeX arXiv:1708.03569

Code (1)

elki-project/elki 공식 구현

Similar Papers 제목 키워드 기반

EmpiriST Corpus 2.0: Adding Manual Normalization, Lemmatization and Semantic Tagging to a German Web and CMC Corpus

2020-05-01 · LREC 2020 5 · Thomas Proisl, Natalie Dykes, Philipp Heinrich, Besim Kabashi 외

The EmpiriST corpus (Bei{\ss}wenger et al., 2016) is a manually tokenized and part-of-speech tagged corpus of approximately 23,000 tokens of German Web and CMC (computer-mediated communication) data. We extend the corpus…

Lemmatization

Boosting word frequencies in authorship attribution

2022-11-02 · Maciej Eder

In this paper, I introduce a simple method of computing relative word frequencies for authorship attribution and similar stylometric tasks. Rather than computing relative frequencies as the number of occurrences of a giv…

Authorship Attribution

hinglishNorm - A Corpus of Hindi-English Code Mixed Sentences for Text Normalization

2020-12-01 · COLING 2020 8 · Piyush Makhija, Ankit Kumar, Anuj Gupta

We present hinglishNorm - a human annotated corpus of Hindi-English code-mixed sentences for text normalization task. Each sentence in the corpus is aligned to its corresponding human annotated normalized form. To the be…

SentenceText NormalizationTranslation

hinglishNorm -- A Corpus of Hindi-English Code Mixed Sentences for Text Normalization

2020-10-18 · Piyush Makhija, Ankit Kumar, Anuj Gupta

We present hinglishNorm -- a human annotated corpus of Hindi-English code-mixed sentences for text normalization task. Each sentence in the corpus is aligned to its corresponding human annotated normalized form. To the b…

SentenceText NormalizationTranslation

Creating Data in Icelandic for Text Normalization

2021-05-01 · NoDaLiDa 2021 5 · Helga Svala Sigurðardóttir, Anna Björk Nikulásdóttir, Jón Guðnason

There is no natural way to acquire normalized data so we try to create good enough data to attempt more advanced methods for text normalization. We manually annotated the first normalized corpus in Icelandic, 40,000 sent…

Text Normalization