ProSiT! Latent Variable Discovery with PROgressive SImilarity Thresholds
The most common ways to explore latent document dimensions are topic models and clustering methods. However, topic models have several drawbacks: e.g., they require us to choose the number of latent dimensions a priori, and the results are stochastic. Most clustering methods have the same issues and lack flexibility in various ways, such as not accounting for the influence of different topics on single documents, forcing word-descriptors to belong to a single topic (hard-clustering) or necessarily relying on word representations. We propose PROgressive SImilarity Thresholds - ProSiT, a deterministic and interpretable method, agnostic to the input format, that finds the optimal number of latent dimensions and only has two hyper-parameters, which can be set efficiently via grid search. We compare this method with a wide range of topic models and clustering methods on four benchmark data sets. In most setting, ProSiT matches or outperforms the other methods in terms six metrics of topic coherence and distinctiveness, producing replicable, deterministic results.
Code (1)
Tasks
ClusteringTopic ModelsSimilar Papers 제목 키워드 기반
Self-learning Scene-specific Pedestrian Detectors using a Progressive Latent Model
In this paper, a self-learning approach is proposed towards solving scene-specific pedestrian detection problem without any human' annotation involved. The self-learning approach is deployed as progressive steps of objec…
ObjectObject DiscoveryObject LocalizationPedestrian Detection+3Latent Variable Discovery Using Dependency Patterns
The causal discovery of Bayesian networks is an active and important research area, and it is based upon searching the space of causal models for those which can best explain a pattern of probabilistic dependencies shown…
Causal DiscoveryProgressive Neural Image Compression with Nested Quantization and Latent Ordering
We present PLONQ, a progressive neural image compression scheme which pushes the boundary of variable bitrate compression by allowing quality scalable coding with a single bitstream. In contrast to existing learned varia…
Image CompressionQuantizationCausal discovery of linear non-Gaussian acyclic models in the presence of latent confounders
Causal discovery from data affected by latent confounders is an important and difficult challenge. Causal functional model-based approaches have not been used to present variables whose relationships are affected by late…
Causal DiscoveryLatent Hierarchical Causal Structure Discovery with Rank Constraints
Most causal discovery procedures assume that there are no latent confounders in the system, which is often violated in real-world problems. In this paper, we consider a challenging scenario for causal structure identific…
Causal Discovery