paper-with-me

Papers

Convolutional Dictionary Learning through Tensor Factorization

2015-06-10 · Furong Huang, Animashree Anandkumar

Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of the observed higher order input moments. However, in many domains, additional invariances such as shift invariances exist, enforced via models such as convolutional dictionary learning. In this paper, we develop novel tensor decomposition algorithms for parameter estimation of convolutional models. Our algorithm is based on the popular alternating least squares method, but with efficient projections onto the space of stacked circulant matrices. Our method is embarrassingly parallel and consists of simple operations such as fast Fourier transforms and matrix multiplications. Our algorithm converges to the dictionary much faster and more accurately compared to the alternating minimization over filters and activation maps.

📄 PDF Abstract BibTeX arXiv:1506.03509

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary Learningparameter estimationTensor DecompositionTopic Models

Similar Papers 제목 키워드 기반

A Tensor-Based Dictionary Learning Approach to Tomographic Image Reconstruction

2015-06-08 · Sara Soltani, Misha E. Kilmer, Per Christian Hansen

We consider tomographic reconstruction using priors in the form of a dictionary learned from training images. The reconstruction has two stages: first we construct a tensor dictionary prior from our training data, and th…

Dictionary LearningImage Reconstruction

Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

2015-12-31 · Zemin Zhang, Shuchin Aeron

In this paper a new dictionary learning algorithm for multidimensional data is proposed. Unlike most conventional dictionary learning methods which are derived for dealing with vectors or matrices, our algorithm, named K…

DenoisingDictionary LearningImage Denoising

Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks

2022-01-27 · Noam Razin, Asaf Maman, Nadav Cohen

In the pursuit of explaining implicit regularization in deep learning, prominent focus was given to matrix and tensor factorizations, which correspond to simplified neural networks. It was shown that these models exhibit…

Deep Tensor Encoding

2017-03-18 · B Sengupta, E Vasquez, Y Qian

Learning an encoding of feature vectors in terms of an over-complete dictionary or a information geometric (Fisher vectors) construct is wide-spread in statistical signal processing and computer vision. In content based …

Information RetrievalRetrieval

Tensor-Dictionary Learning with Deep Kruskal-Factor Analysis

2016-12-08 · Andrew Stevens, Yunchen Pu, Yannan Sun, Greg Spell 외

A multi-way factor analysis model is introduced for tensor-variate data of any order. Each data item is represented as a (sparse) sum of Kruskal decompositions, a Kruskal-factor analysis (KFA). KFA is nonparametric and c…

DenoisingDictionary LearningGeneral Classificationimage-classification+1