paper-with-me

Papers

Gen-A: Generalizing Ambisonics Neural Encoding to Unseen Microphone Arrays

2025-01-14 · Mikko Heikkinen, Archontis Politis, Konstantinos Drossos, Tuomas Virtanen

Using deep neural networks (DNNs) for encoding of microphone array (MA) signals to the Ambisonics spatial audio format can surpass certain limitations of established conventional methods, but existing DNN-based methods need to be trained separately for each MA. This paper proposes a DNN-based method for Ambisonics encoding that can generalize to arbitrary MA geometries unseen during training. The method takes as inputs the MA geometry and MA signals and uses a multi-level encoder consisting of separate paths for geometry and signal data, where geometry features inform the signal encoder at each level. The method is validated in simulated anechoic and reverberant conditions with one and two sources. The results indicate improvement over conventional encoding across the whole frequency range for dry scenes, while for reverberant scenes the improvement is frequency-dependent.

📄 PDF Abstract BibTeX arXiv:2501.08047

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Neural Ambisonics encoding for compact irregular microphone arrays

2024-01-11 · Mikko Heikkinen, Archontis Politis, Tuomas Virtanen

Ambisonics encoding of microphone array signals can enable various spatial audio applications, such as virtual reality or telepresence, but it is typically designed for uniformly-spaced spherical microphone arrays. This …

Ambisonics Encoding For Arbitrary Microphone Arrays Incorporating Residual Channels For Binaural Reproduction

2024-02-27 · Yhonatan Gayer, Vladimir Tourbabin, Zamir Ben-Hur, Jacob Donley 외

In the rapidly evolving fields of virtual and augmented reality, accurate spatial audio capture and reproduction are essential. For these applications, Ambisonics has emerged as a standard format. However, existing metho…

Neural Ambisonic Encoding For Multi-Speaker Scenarios Using A Circular Microphone Array

2024-09-11 · Yue Qiao, Vinay Kothapally, Meng Yu, Dong Yu

Spatial audio formats like Ambisonics are playback device layout-agnostic and well-suited for applications such as teleconferencing and virtual reality. Conventional Ambisonic encoding methods often rely on spherical mic…

Ambisonic Encoding of Signals From Equatorial Microphone Arrays

2022-09-18 · Jens Ahrens

The equatorial microphone array presented in (Ahrens et al., 2021) computes a spherical harmonic (SH) representation of a sound field based on pressure sensors along the equator of a rigid spherical baffle. The original …

L3DAS21 Challenge: Machine Learning for 3D Audio Signal Processing

2021-04-12 · Eric Guizzo, Riccardo F. Gramaccioni, Saeid Jamili, Christian Marinoni 외

The L3DAS21 Challenge is aimed at encouraging and fostering collaborative research on machine learning for 3D audio signal processing, with particular focus on 3D speech enhancement (SE) and 3D sound localization and det…

Audio Signal ProcessingBIG-bench Machine LearningSpeech Enhancement