Distributed dictionary learning over a sensor network
We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks. Diffusion cooperation schemes have been proposed to solve the distributed linear regression problem. In this work we focus on a diffusion-based adaptive dictionary learning strategy: each node records observations and cooperates with its neighbors by sharing its local dictionary. The resulting algorithm corresponds to a distributed block coordinate descent (alternate optimization). Beyond dictionary learning, this strategy could be adapted to many matrix factorization problems and generalized to various settings. This article presents our approach and illustrates its efficiency on some numerical examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Dictionary LearningregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Observable dictionary learning for high-dimensional statistical inference
This paper introduces a method for efficiently inferring a high-dimensional distributed quantity from a few observations. The quantity of interest (QoI) is approximated in a basis (dictionary) learned from a training set…
Dictionary LearningVocal Bursts Intensity PredictionDecentralized Dictionary Learning Over Time-Varying Digraphs
This paper studies Dictionary Learning problems wherein the learning task is distributed over a multi-agent network, modeled as a time-varying directed graph. This formulation is relevant, for instance, in Big Data scena…
Dictionary LearningLocal Information with Feedback Perturbation Suffices for Dictionary Learning in Neural Circuits
While the sparse coding principle can successfully model information processing in sensory neural systems, it remains unclear how learning can be accomplished under neural architectural constraints. Feasible learning rul…
Dictionary LearningCloud K-SVD: A Collaborative Dictionary Learning Algorithm for Big, Distributed Data
This paper studies the problem of data-adaptive representations for big, distributed data. It is assumed that a number of geographically-distributed, interconnected sites have massive local data and they are interested i…
Dictionary LearningDecentralized Dynamic Discriminative Dictionary Learning
We consider discriminative dictionary learning in a distributed online setting, where a network of agents aims to learn a common set of dictionary elements of a feature space and model parameters while sequentially recei…
Dictionary Learning