paper-with-me

홈 › Papers

NIIRF: Neural IIR Filter Field for HRTF Upsampling and Personalization

2024-02-27 · Yoshiki Masuyama, Gordon Wichern, François G. Germain, Zexu Pan, Sameer Khurana, Chiori Hori, Jonathan Le Roux

Head-related transfer functions (HRTFs) are important for immersive audio, and their spatial interpolation has been studied to upsample finite measurements. Recently, neural fields (NFs) which map from sound source direction to HRTF have gained attention. Existing NF-based methods focused on estimating the magnitude of the HRTF from a given sound source direction, and the magnitude is converted to a finite impulse response (FIR) filter. We propose the neural infinite impulse response filter field (NIIRF) method that instead estimates the coefficients of cascaded IIR filters. IIR filters mimic the modal nature of HRTFs, thus needing fewer coefficients to approximate them well compared to FIR filters. We find that our method can match the performance of existing NF-based methods on multiple datasets, even outperforming them when measurements are sparse. We also explore approaches to personalize the NF to a subject and experimentally find low-rank adaptation to be effective.

📄 PDF Abstract BibTeX arXiv:2402.17907

Code (1)

merlresearch/neural-iir-field 공식 구현 pytorch

Tasks

Spatial Interpolation

Similar Papers 제목 키워드 기반

Retrieval-Augmented Neural Field for HRTF Upsampling and Personalization

2025-01-22 · Yoshiki Masuyama, Gordon Wichern, François G. Germain, Christopher Ick 외

Head-related transfer functions (HRTFs) with dense spatial grids are desired for immersive binaural audio generation, but their recording is time-consuming. Although HRTF spatial upsampling has shown remarkable progress …

Audio GenerationRetrievalTask 2

Spatial Upsampling of Head-Related Transfer Functions Using a Physics-Informed Neural Network

2023-07-27 · Fei Ma, Thushara D. Abhayapala, Prasanga N. Samarasinghe, Xingyu Chen

Head-related transfer function (HRTF) capture the information that a person uses to localize sound sources in space, and thus is crucial for creating personalized virtual acoustic experiences. However, practical HRTF mea…

valid

HRTF upsampling with a generative adversarial network using a gnomonic equiangular projection

2023-06-09 · Aidan O. T. Hogg, Mads Jenkins, He Liu, Isaac Squires 외

An individualised head-related transfer function (HRTF) is very important for creating realistic virtual reality (VR) and augmented reality (AR) environments. However, acoustically measuring high-quality HRTFs requires e…

Generative Adversarial NetworkSuper-Resolution

HRTFformer: A Spatially-Aware Transformer for Individual HRTF Upsampling in Immersive Audio Rendering

2025-10-02 · Xuyi Hu, Jian Li, Shaojie Zhang, Stefan Goetz 외 arxiv

Individual Head-Related Transfer Functions (HRTFs) are starting to be introduced in many commercial immersive audio applications and are crucial for realistic spatial audio rendering. However, one of the main hesitations…

A Machine Learning Approach for Denoising and Upsampling HRTFs

2025-04-24 · Xuyi Hu, Jian Li, Lorenzo Picinali, Aidan O. T. Hogg

The demand for realistic virtual immersive audio continues to grow, with Head-Related Transfer Functions (HRTFs) playing a key role. HRTFs capture how sound reaches our ears, reflecting unique anatomical features and enh…

DenoisingGenerative Adversarial Network