GINopic: Topic Modeling with Graph Isomorphism Network
Topic modeling is a widely used approach for analyzing and exploring large document collections. Recent research efforts have incorporated pre-trained contextualized language models, such as BERT embeddings, into topic modeling. However, they often neglect the intrinsic informational value conveyed by mutual dependencies between words. In this study, we introduce GINopic, a topic modeling framework based on graph isomorphism networks to capture the correlation between words. By conducting intrinsic (quantitative as well as qualitative) and extrinsic evaluations on diverse benchmark datasets, we demonstrate the effectiveness of GINopic compared to existing topic models and highlight its potential for advancing topic modeling.
Code (1)
Tasks
Topic ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Graph Convolutional Networks with Dual Message Passing for Subgraph Isomorphism Counting and Matching
Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge mod…
Node ClassificationRepresentation LearningMathematical representation of the structure of neuron-glia networks
Network representations of the nervous system have been useful for the understanding of brain phenomena such as perception, motor coordination, and memory. Although brains are composed of both neurons and glial cells, ne…
Neural Subgraph Isomorphism Counting
In this paper, we study a new graph learning problem: learning to count subgraph isomorphisms. Different from other traditional graph learning problems such as node classification and link prediction, subgraph isomorphis…
Domain AdaptationGraph LearningLink PredictionNode Classification+2Casting graph isomorphism as a point set registration problem using a simplex embedding and sampling
Graph isomorphism is an important problem as its worst-case time complexity is not yet fully understood. In this study, we try to draw parallels between a related optimization problem called point set registration. A gra…
Tracing Source Language Interference in Translation with Graph-Isomorphism Measures
Previous research has used linguistic features to show that translations exhibit traces of source language interference and that phylogenetic trees between languages can be reconstructed from the results of translations …
Open-Ended Question AnsweringTranslation