Efficient Learning for Undirected Topic Models
Replicated Softmax model, a well-known undirected topic model, is powerful in extracting semantic representations of documents. Traditional learning strategies such as Contrastive Divergence are very inefficient. This paper provides a novel estimator to speed up the learning based on Noise Contrastive Estimate, extended for documents of variant lengths and weighted inputs. Experiments on two benchmarks show that the new estimator achieves great learning efficiency and high accuracy on document retrieval and classification.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationRetrievalTopic ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Replicated Softmax: an Undirected Topic Model
We show how to model documents as bags of words using family of two-layer, undirected graphical models. Each member of the family has the same number of binary hidden units but a different number of ``softmax visible uni…
modelPen and Paper Exercises in Machine Learning
This is a collection of (mostly) pen-and-paper exercises in machine learning. The exercises are on the following topics: linear algebra, optimisation, directed graphical models, undirected graphical models, expressive po…
BIG-bench Machine LearningRelevance Topic Model for Unstructured Social Group Activity Recognition
Unstructured social group activity recognition in web videos is a challenging task due to 1) the semantic gap between class labels and low-level visual features and 2) the lack of labeled training data. To tackle this pr…
Activity RecognitionAttributeGroup Activity Recognitionparameter estimation+1Topic Aware Contextualized Embeddings for High Quality Phrase Extraction
Keyphrase extraction from a given document is the task of automatically extracting salient phrases that best describe the document. This paper proposes a novel unsupervised graph-based ranking method to extract high-qual…
Keyphrase ExtractionVocal Bursts Intensity PredictionAn information-theoretic framework to measure the dynamic interaction between neural spike trains
Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been …
Point Processes