paper-with-me

Papers

HRTF Interpolation using a Spherical Neural Process Meta-Learner

2023-10-20 · Etienne Thuillier, Craig Jin, Vesa Välimäki

Several individualization methods have recently been proposed to estimate a subject's Head-Related Transfer Function (HRTF) using convenient input modalities such as anthropometric measurements or pinnae photographs. There exists a need for adaptively correcting the estimation error committed by such methods using a few data point samples from the subject's HRTF, acquired using acoustic measurements or perceptual feedback. To this end, we introduce a Convolutional Conditional Neural Process meta-learner specialized in HRTF error interpolation. In particular, the model includes a Spherical Convolutional Neural Network component to accommodate the spherical geometry of HRTF data. It also exploits potential symmetries between the HRTF's left and right channels about the median axis. In this work, we evaluate the proposed model's performance purely on time-aligned spectrum interpolation grounds under a simplified setup where a generic population-mean HRTF forms the initial estimates prior to corrections instead of individualized ones. The trained model achieves up to 3 dB relative error reduction compared to state-of-the-art interpolation methods despite being trained using only 85 subjects. This improvement translates up to nearly a halving of the data point count required to achieve comparable accuracy, in particular from 50 to 28 points to reach an average of -20 dB relative error per interpolated feature. Moreover, we show that the trained model provides well-calibrated uncertainty estimates. Accordingly, such estimates can inform the sequential decision problem of acquiring as few correcting HRTF data points as needed to meet a desired level of HRTF individualization accuracy.

📄 PDF Abstract BibTeX arXiv:2310.13430

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Head-Related Transfer Function Interpolation with a Spherical CNN

2023-09-15 · Xingyu Chen, Fei Ma, Yile Zhang, Amy Bastine 외

Head-related transfer functions (HRTFs) are crucial for spatial soundfield reproduction in virtual reality applications. However, obtaining personalized, high-resolution HRTFs is a time-consuming and costly task. Recentl…

Continuous head-related transfer function representation based on hyperspherical harmonics

2022-09-12 · Adam Szwajcowski

Expressing head-related transfer functions (HRTFs) in spherical harmonic (SH) domain has been thoroughly studied as a method of obtaining continuity over space. However, HRTFs are functions not only of direction but also…

Spatial Upsampling of Head-Related Transfer Functions Using a Physics-Informed Neural Network

2023-07-27 · Fei Ma, Thushara D. Abhayapala, Prasanga N. Samarasinghe, Xingyu Chen

Head-related transfer function (HRTF) capture the information that a person uses to localize sound sources in space, and thus is crucial for creating personalized virtual acoustic experiences. However, practical HRTF mea…

valid

Magnitude-Corrected and Time-Aligned Interpolation of Head-Related Transfer Functions

2023-03-17 · Johannes M. Arend, Christoph Pörschmann, Stefan Weinzierl, Fabian Brinkmann

Head-related transfer functions (HRTFs) are essential for virtual acoustic realities, as they contain all cues for localizing sound sources in three-dimensional space. Acoustic measurements are one way to obtain high-qua…

Efficient representation of head-related transfer functions in continuous space-frequency domains

2023-07-18 · Adam Szwajcowski

Utilizing spherical harmonic (SH) domain has been established as the default method of obtaining continuity over space in head-related transfer functions (HRTFs). This paper concerns different variants of extending this …