paper-with-me

홈 › Papers

Auto-Encoding Variational Bayes for Inferring Topics and Visualization

2020-10-19 · COLING 2020 8 · Dang Pham, Tuan M. V. Le

Visualization and topic modeling are widely used approaches for text analysis. Traditional visualization methods find low-dimensional representations of documents in the visualization space (typically 2D or 3D) that can be displayed using a scatterplot. In contrast, topic modeling aims to discover topics from text, but for visualization, one needs to perform a post-hoc embedding using dimensionality reduction methods. Recent approaches propose using a generative model to jointly find topics and visualization, allowing the semantics to be infused in the visualization space for a meaningful interpretation. A major challenge that prevents these methods from being used practically is the scalability of their inference algorithms. We present, to the best of our knowledge, the first fast Auto-Encoding Variational Bayes based inference method for jointly inferring topics and visualization. Since our method is black box, it can handle model changes efficiently with little mathematical rederivation effort. We demonstrate the efficiency and effectiveness of our method on real-world large datasets and compare it with existing baselines.

📄 PDF Abstract BibTeX arXiv:2010.09233

Code (1)

dangpnh2/plsv_vae 공식 구현 pytorch

Tasks

Dimensionality Reduction

Similar Papers 제목 키워드 기반

Structured Neural Topic Models for Reviews

2018-12-12 · Babak Esmaeili, Hongyi Huang, Byron C. Wallace, Jan-Willem van de Meent

We present Variational Aspect-based Latent Topic Allocation (VALTA), a family of autoencoding topic models that learn aspect-based representations of reviews. VALTA defines a user-item encoder that maps bag-of-words vect…

SentenceTopic Models

Autoencoding Variational Inference For Topic Models

2017-03-04 · Akash Srivastava, Charles Sutton

Topic models are one of the most popular methods for learning representations of text, but a major challenge is that any change to the topic model requires mathematically deriving a new inference algorithm. A promising a…

Topic ModelsVariational Inference

Tree-Structured Neural Topic Model

2020-07-01 · ACL 2020 6 · Masaru Isonuma, Junichiro Mori, Danushka Bollegala, Ichiro Sakata

This paper presents a tree-structured neural topic model, which has a topic distribution over a tree with an infinite number of branches. Our model parameterizes an unbounded ancestral and fraternal topic distribution by…

model

Note: Variational Encoding of Protein Dynamics Benefits from Maximizing Latent Autocorrelation

2018-03-17 · Hannah K. Wayment-Steele, Vijay S. Pande

As deep Variational Auto-Encoder (VAE) frameworks become more widely used for modeling biomolecular simulation data, we emphasize the capability of the VAE architecture to concurrently maximize the timescale of the laten…

Deep Autoencoding Topic Model with Scalable Hybrid Bayesian Inference

2020-06-15 · Hao Zhang, Bo Chen, Yulai Cong, Dandan Guo 외

To build a flexible and interpretable model for document analysis, we develop deep autoencoding topic model (DATM) that uses a hierarchy of gamma distributions to construct its multi-stochastic-layer generative network. …

Bayesian Inference