paper-with-me

홈 › Papers

Sparse, complex-valued representations of natural sounds learned with phase and amplitude continuity priors

2013-12-17 · Wiktor Mlynarski

Complex-valued sparse coding is a data representation which employs a dictionary of two-dimensional subspaces, while imposing a sparse, factorial prior on complex amplitudes. When trained on a dataset of natural image patches, it learns phase invariant features which closely resemble receptive fields of complex cells in the visual cortex. Features trained on natural sounds however, rarely reveal phase invariance and capture other aspects of the data. This observation is a starting point of the present work. As its first contribution, it provides an analysis of natural sound statistics by means of learning sparse, complex representations of short speech intervals. Secondly, it proposes priors over the basis function set, which bias them towards phase-invariant solutions. In this way, a dictionary of complex basis functions can be learned from the data statistics, while preserving the phase invariance property. Finally, representations trained on speech sounds with and without priors are compared. Prior-based basis functions reveal performance comparable to unconstrained sparse coding, while explicitely representing phase as a temporal shift. Such representations can find applications in many perceptual and machine learning tasks.

📄 PDF Abstract BibTeX arXiv:1312.4695

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Mid-Level Auditory Codes from Natural Sound Statistics

2017-10-15

Interaction with the world requires an organism to transform sensory signals into representations in which behaviorally meaningful properties of the environment are made explicit. These representations are derived throug…

Co-domain Symmetry for Complex-Valued Deep Learning

2021-12-02 · CVPR 2022 1 · Utkarsh Singhal, Yifei Xing, Stella X. Yu

We study complex-valued scaling as a type of symmetry natural and unique to complex-valued measurements and representations. Deep Complex Networks (DCN) extends real-valued algebra to the complex domain without addressin…

Deep Learning

RVFL-X: A Novel Randomized Network Based on Complex Transformed Real-Valued Tabular Datasets

2025-10-06 · M. Sajid, Mushir Akhtar, A. Quadir, M. Tanveer arxiv

Recent advancements in neural networks, supported by foundational theoretical insights, emphasize the superior representational power of complex numbers. However, their adoption in randomized neural networks (RNNs) has b…

A Sparse Non-Parametric Approach for Single Channel Separation of Known Sounds

2009-12-01 · NeurIPS 2009 12 · Paris Smaragdis, Madhusudana Shashanka, Bhiksha Raj

In this paper we present an algorithm for separating mixed sounds from a monophonic recording. Our approach makes use of training data which allows us to learn representations of the types of sounds that compose the m…

Bayesian Sparsification Methods for Deep Complex-valued Networks

2020-03-25 · Ivan Nazarov, Evgeny Burnaev

With continual miniaturization ever more applications of deep learning can be found in embedded systems, where it is common to encounter data with natural complex domain representation. To this end we extend Sparse Varia…

Music Transcription