Sinusoidal wave generating network based on adversarial learning and its application: synthesizing frog sounds for data augmentation
Simulators that generate observations based on theoretical models can be important tools for development, prediction, and assessment of signal processing algorithms. In order to design these simulators, painstaking effort is required to construct mathematical models according to their application. Complex models are sometimes necessary to represent a variety of real phenomena. In contrast, obtaining synthetic observations from generative models developed from real observations often require much less effort. This paper proposes a generative model based on adversarial learning. Given that observations are typically signals composed of a linear combination of sinusoidal waves and random noises, sinusoidal wave generating networks are first designed based on an adversarial network. Audio waveform generation can then be performed using the proposed network. Several approaches to designing the objective function of the proposed network using adversarial learning are investigated experimentally. In addition, amphibian sound classification is performed using a convolutional neural network trained with real and synthetic sounds. Both qualitative and quantitative results show that the proposed generative model makes realistic signals and is very helpful for data augmentation and data analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationSound ClassificationSimilar Papers 제목 키워드 기반
Gradient-Descent Based Optimization of Multi-Tone Sinusoidal Frequency Modulated Waveforms
This paper describes a gradient-descent based optimization algorithm for synthesizing Multi-Tone Sinusoidal Frequency Modulated (MTSFM) waveforms with low Auto-Correlation Function (ACF) sidelobes in a specified region o…
Computational EfficiencyAdversarial Audio Synthesis
Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales. Generative adversarial networks (GANs) have seen wide success at generat…
Audio GenerationAudio SynthesisImage GenerationGenerating Waveform Families using Multi-Tone Sinusoidal Frequency Modulation
This paper presents a method for generating a family of waveforms with low in-band Auto/Cross-Correlation Function (ACF/CCF) properties using the Multi-Tone Sinusoidal Frequency Modulated (MTSFM) waveform model. The MTSF…
Unified Source-Filter GAN: Unified Source-filter Network Based On Factorization of Quasi-Periodic Parallel WaveGAN
We propose a unified approach to data-driven source-filter modeling using a single neural network for developing a neural vocoder capable of generating high-quality synthetic speech waveforms while retaining flexibility …
Adversarial Generation of Time-Frequency Features with application in audio synthesis
Time-frequency (TF) representations provide powerful and intuitive features for the analysis of time series such as audio. But still, generative modeling of audio in the TF domain is a subtle matter. Consequently, neural…
Audio GenerationAudio SynthesisGenerative Adversarial NetworkTime Series+1