paper-with-me

홈 › Papers

Efficient Learning for Undirected Topic Models

2015-06-24 · IJCNLP 2015 7 · Jiatao Gu, Victor O. K. Li

Replicated Softmax model, a well-known undirected topic model, is powerful in extracting semantic representations of documents. Traditional learning strategies such as Contrastive Divergence are very inefficient. This paper provides a novel estimator to speed up the learning based on Noise Contrastive Estimate, extended for documents of variant lengths and weighted inputs. Experiments on two benchmarks show that the new estimator achieves great learning efficiency and high accuracy on document retrieval and classification.

📄 PDF Abstract BibTeX arXiv:1506.07477

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationRetrievalTopic Models

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Replicated Softmax: an Undirected Topic Model

2009-12-01 · NeurIPS 2009 12 · Geoffrey E. Hinton, Ruslan R. Salakhutdinov

We show how to model documents as bags of words using family of two-layer, undirected graphical models. Each member of the family has the same number of binary hidden units but a different number of ``softmax visible uni…

model

Pen and Paper Exercises in Machine Learning

2022-06-27 · Michael U. Gutmann

This is a collection of (mostly) pen-and-paper exercises in machine learning. The exercises are on the following topics: linear algebra, optimisation, directed graphical models, undirected graphical models, expressive po…

BIG-bench Machine Learning

Relevance Topic Model for Unstructured Social Group Activity Recognition

2013-12-01 · NeurIPS 2013 12 · Fang Zhao, Yongzhen Huang, Liang Wang, Tieniu Tan

Unstructured social group activity recognition in web videos is a challenging task due to 1) the semantic gap between class labels and low-level visual features and 2) the lack of labeled training data. To tackle this pr…

Activity RecognitionAttributeGroup Activity Recognitionparameter estimation+1

Topic Aware Contextualized Embeddings for High Quality Phrase Extraction

2022-01-17 · Venktesh V, Mukesh Mohania, Vikram Goyal

Keyphrase extraction from a given document is the task of automatically extracting salient phrases that best describe the document. This paper proposes a novel unsupervised graph-based ranking method to extract high-qual…

Keyphrase ExtractionVocal Bursts Intensity Prediction

An information-theoretic framework to measure the dynamic interaction between neural spike trains

2020-12-15 · Gorana Mijatovic, Yuri Antonacci, Tatjana Loncar-Turukalo, Ludovico Minati 외

Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been …

Point Processes