Topic-aware latent models for representation learning on networks
Network representation learning (NRL) methods have received significant attention over the last years thanks to their success in several graph analysis problems, including node classification, link prediction, and clustering. Such methods aim to map each vertex of the network into a low-dimensional space in a way that the structural information of the network is preserved. Of particular interest are methods based on random walks; such methods transform the network into a collection of node sequences, aiming to learn node representations by predicting the context of each node within the sequence. In this paper, we introduce TNE, a generic framework to enhance the embeddings of nodes acquired by means of random walk-based approaches with topic-based information. Similar to the concept of topical word embeddings in Natural Language Processing, the proposed model first assigns each node to a latent community with the favor of various statistical graph models and community detection methods and then learns the enhanced topic-aware representations. We evaluate our methodology in two downstream tasks: node classification and link prediction. The experimental results demonstrate that by incorporating node and community embeddings, we are able to outperform widely-known baseline NRL models.
Code (0)
등록된 구현이 없습니다.
Tasks
Community DetectionLink PredictionNode ClassificationRepresentation LearningWord EmbeddingsSimilar Papers 제목 키워드 기반
Latent Topic-aware Multi-Label Classification
In real-world applications, data are often associated with different labels. Although most extant multi-label learning algorithms consider the label correlations, they rarely consider the topic information hidden in the …
ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1Topic-Aware Neural Keyphrase Generation for Social Media Language
A huge volume of user-generated content is daily produced on social media. To facilitate automatic language understanding, we study keyphrase prediction, distilling salient information from massive posts. While most exis…
Keyphrase GenerationExplainable and Discourse Topic-aware Neural Language Understanding
Marrying topic models and language models exposes language understanding to a broader source of document-level context beyond sentences via topics. While introducing topical semantics in language models, existing approac…
Document ClassificationLanguage ModelingLanguage ModellingRetrieval+4TITA: A Two-stage Interaction and Topic-Aware Text Matching Model
In this paper, we focus on the problem of keyword and document matching by considering different relevance levels. In our recommendation system, different people follow different hot keywords with interest. We need to at…
Text MatchingVocal Bursts Valence PredictionImproving Topic Models with Latent Feature Word Representations
Probabilistic topic models are widely used to discover latent topics in document collections, while latent feature vector representations of words have been used to obtain high performance in many NLP tasks. In this pape…
ClusteringDocument ClassificationGeneral ClassificationTopic Models