Modeling image patches with a directed hierarchy of Markov random fields
We describe an efficient learning procedure for multilayer generative models that combine the best aspects of Markov random fields and deep, directed belief nets. The generative models can be learned one layer at a time and when learning is complete they have a very fast inference procedure for computing a good approximation to the posterior distribution in all of the hidden layers. Each hidden layer has its own MRF whose energy function is modulated by the top-down directed connections from the layer above. To generate from the model, each layer in turn must settle to equilibrium given its top-down input. We show that this type of model is good at capturing the statistics of patches of natural images.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Functional voxel hierarchy and afferent capacity revealed mental state transition on dynamic correlation resting-state fMRI
Voxel hierarchy on dynamic brain graphs is produced by k core percolation on functional dynamic amplitude correlation of resting-state fMRI. Directed graphs and their afferent/efferent capacities are produced by Markov m…
Functional ConnectivityPredictive Coding with Bayesian Priors via Proximal Gradients
We recast predictive coding as continuous-time proximal gradient descent applied to a regularized maximum-a-posteriori (MAP) objective. We study first a single-level problem and then a multi-level hierarchy. For the sing…
A review of Gaussian Markov models for conditional independence
Markov models lie at the interface between statistical independence in a probability distribution and graph separation properties. We review model selection and estimation in directed and undirected Markov models with Ga…
Model SelectionTwo-sample testingHierarchy-Aware Global Model for Hierarchical Text Classification
Hierarchical text classification is an essential yet challenging subtask of multi-label text classification with a taxonomic hierarchy. Existing methods have difficulties in modeling the hierarchical label structure in a…
ClassificationGeneral ClassificationHierarchical Multi-label Classificationmodel+4Building Vision Transformers with Hierarchy Aware Feature Aggregation
Thanks to the excellent global modeling capability of attention mechanisms, the Vision Transformer has achieved better results than ConvNet in many computer tasks. However, in generating hierarchical feature maps, th…
image-classificationImage Classificationobject-detectionObject Detection+1