Audio-to-Image Encoding for Improved Voice Characteristic Detection Using Deep Convolutional Neural Networks
This paper introduces a novel audio-to-image encoding framework that integrates multiple dimensions of voice characteristics into a single RGB image for speaker recognition. In this method, the green channel encodes raw audio data, the red channel embeds statistical descriptors of the voice signal (including key metrics such as median and mean values for fundamental frequency, spectral centroid, bandwidth, rolloff, zero-crossing rate, MFCCs, RMS energy, spectral flatness, spectral contrast, chroma, and harmonic-to-noise ratio), and the blue channel comprises subframes representing these features in a spatially organized format. A deep convolutional neural network trained on these composite images achieves 98% accuracy in speaker classification across two speakers, suggesting that this integrated multi-channel representation can provide a more discriminative input for voice recognition tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Speaker RecognitionSimilar Papers 제목 키워드 기반
Securing Voice-driven Interfaces against Fake (Cloned) Audio Attacks
Voice cloning technologies have found applications in a variety of areas ranging from personalized speech interfaces to advertisement, robotics, and so on. Existing voice cloning systems are capable of learning speaker c…
Speech SynthesisVoice CloningSelf Voice Conversion as an Attack against Neural Audio Watermarking
Audio watermarking embeds auxiliary information into speech while maintaining speaker identity, linguistic content, and perceptual quality. Although recent advances in neural and digital signal processing-based watermark…
Voice ConversionID-LoRA: Identity-Driven Audio-Video Personalization with In-Context LoRA
Existing video personalization methods preserve visual likeness but treat video and audio separately. Without access to the visual scene, audio models cannot synchronize sounds with on-screen actions; and because classic…
Revival with Voice: Multi-modal Controllable Text-to-Speech Synthesis
This paper explores multi-modal controllable Text-to-Speech Synthesis (TTS) where the voice can be generated from face image, and the characteristics of output speech (e.g., pace, noise level, distance, tone, place) can …
Speech Synthesistext-to-speechText to SpeechText-To-Speech SynthesisAdvancing Voice Cloning for Nepali: Leveraging Transfer Learning in a Low-Resource Language
Voice cloning is a prominent feature in personalized speech interfaces. A neural vocal cloning system can mimic someone's voice using just a few audio samples. Both speaker encoding and speaker adaptation are topics of r…
Transfer LearningVoice Cloning