Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles
Production of news content is growing at an astonishing rate. To help manage and monitor the sheer amount of text, there is an increasing need to develop efficient methods that can provide insights into emerging content areas, and stratify unstructured corpora of text into `topics' that stem intrinsically from content similarity. Here we present an unsupervised framework that brings together powerful vector embeddings from natural language processing with tools from multiscale graph partitioning that can reveal natural partitions at different resolutions without making a priori assumptions about the number of clusters in the corpus. We show the advantages of graph-based clustering through end-to-end comparisons with other popular clustering and topic modelling methods, and also evaluate different text vector embeddings, from classic Bag-of-Words to Doc2Vec to the recent transformers based model Bert. This comparative work is showcased through an analysis of a corpus of US news coverage during the presidential election year of 2016.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesClusteringgraph partitioningSimilar Papers 제목 키워드 기반
Topic Aware Contextualized Embeddings for High Quality Phrase Extraction
Keyphrase extraction from a given document is the task of automatically extracting salient phrases that best describe the document. This paper proposes a novel unsupervised graph-based ranking method to extract high-qual…
Keyphrase ExtractionVocal Bursts Intensity PredictionCWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling
Most existing topic models rely on bag-of-words (BOW) representation, which limits their ability to capture word order information and leads to challenges with out-of-vocabulary (OOV) words in new documents. Contextualiz…
Document ClassificationLanguage ModellingNatural Language UnderstandingNER+3Revisiting Semi-Supervised Learning with Graph Embeddings
We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the g…
Document ClassificationEntity Extraction using GANGeneral ClassificationNode Classification+1A Neural Generative Model for Joint Learning Topics and Topic-Specific Word Embeddings
We propose a novel generative model to explore both local and global context for joint learning topics and topic-specific word embeddings. In particular, we assume that global latent topics are shared across documents, a…
Sentiment AnalysisSentiment ClassificationTopic ModelsWord Embeddings+2Revisiting Embeddings for Graph Neural Networks
Current graph representation learning techniques use Graph Neural Networks (GNNs) to extract features from dataset embeddings. In this work, we examine the quality of these embeddings and assess how changing them can aff…
Graph Representation LearningRepresentation Learningtext-classificationText Classification