paper-with-me

홈 › Papers

Gaussian Process Convolutional Dictionary Learning

2021-03-28 · Andrew H. Song, Bahareh Tolooshams, Demba Ba

Convolutional dictionary learning (CDL), the problem of estimating shift-invariant templates from data, is typically conducted in the absence of a prior/structure on the templates. In data-scarce or low signal-to-noise ratio (SNR) regimes, learned templates overfit the data and lack smoothness, which can affect the predictive performance of downstream tasks. To address this limitation, we propose GPCDL, a convolutional dictionary learning framework that enforces priors on templates using Gaussian Processes (GPs). With the focus on smoothness, we show theoretically that imposing a GP prior is equivalent to Wiener filtering the learned templates, thereby suppressing high-frequency components and promoting smoothness. We show that the algorithm is a simple extension of the classical iteratively reweighted least squares algorithm, independent of the choice of GP kernels. This property allows one to experiment flexibly with different smoothness assumptions. Through simulation, we show that GPCDL learns smooth dictionaries with better accuracy than the unregularized alternative across a range of SNRs. Through an application to neural spiking data, we show that GPCDL learns a more accurate and visually-interpretable smooth dictionary, leading to superior predictive performance compared to non-regularized CDL, as well as parametric alternatives.

📄 PDF Abstract BibTeX arXiv:2104.00530

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary LearningGaussian Processes

Similar Papers 제목 키워드 기반

Learning Deep Analysis Dictionaries -- Part II: Convolutional Dictionaries

2020-01-31 · Jun-Jie Huang, Pier Luigi Dragotti

In this paper, we introduce a Deep Convolutional Analysis Dictionary Model (DeepCAM) by learning convolutional dictionaries instead of unstructured dictionaries as in the case of deep analysis dictionary model introduced…

ClusteringDictionary LearningImage Super-ResolutionSuper-Resolution

The Temporal Dictionary Ensemble (TDE) Classifier for Time Series Classification

2021-05-09 · Matthew Middlehurst, James Large, Gavin Cawley, Anthony Bagnall

Using bag of words representations of time series is a popular approach to time series classification. These algorithms involve approximating and discretising windows over a series to form words, then forming a count of …

ClassificationGeneral ClassificationTime SeriesTime Series Analysis+1

First and Second Order Methods for Online Convolutional Dictionary Learning

2017-08-31 · Jialin Liu, Cristina Garcia-Cardona, Brendt Wohlberg, Wotao Yin

Convolutional sparse representations are a form of sparse representation with a structured, translation invariant dictionary. Most convolutional dictionary learning algorithms to date operate in batch mode, requiring sim…

Dictionary LearningSecond-order methodsTranslation

Convolutional Dictionary Pair Learning Network for Image Representation Learning

2019-12-17 · Zhao Zhang, Yulin Sun, Yang Wang, Zheng-Jun Zha 외

Both the Dictionary Learning (DL) and Convolutional Neural Networks (CNN) are powerful image representation learning systems based on different mechanisms and principles, however whether we can seamlessly integrate them …

Dictionary LearningRepresentation Learning

A Universal Analysis of Large-Scale Regularized Least Squares Solutions

2017-12-01 · NeurIPS 2017 12 · Ashkan Panahi, Babak Hassibi

A problem that has been of recent interest in statistical inference, machine learning and signal processing is that of understanding the asymptotic behavior of regularized least squares solutions under random measurement…

valid