paper-with-me

홈 › Papers

A Machine Learning Approach for Denoising and Upsampling HRTFs

2025-04-24 · Xuyi Hu, Jian Li, Lorenzo Picinali, Aidan O. T. Hogg

The demand for realistic virtual immersive audio continues to grow, with Head-Related Transfer Functions (HRTFs) playing a key role. HRTFs capture how sound reaches our ears, reflecting unique anatomical features and enhancing spatial perception. It has been shown that personalized HRTFs improve localization accuracy, but their measurement remains time-consuming and requires a noise-free environment. Although machine learning has been shown to reduce the required measurement points and, thus, the measurement time, a controlled environment is still necessary. This paper proposes a method to address this constraint by presenting a novel technique that can upsample sparse, noisy HRTF measurements. The proposed approach combines an HRTF Denoisy U-Net for denoising and an Autoencoding Generative Adversarial Network (AE-GAN) for upsampling from three measurement points. The proposed method achieves a log-spectral distortion (LSD) error of 5.41 dB and a cosine similarity loss of 0.0070, demonstrating the method's effectiveness in HRTF upsampling.

📄 PDF Abstract BibTeX arXiv:2504.17586

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingGenerative Adversarial Network

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

HRTFformer: A Spatially-Aware Transformer for Individual HRTF Upsampling in Immersive Audio Rendering

2025-10-02 · Xuyi Hu, Jian Li, Shaojie Zhang, Stefan Goetz 외 arxiv

Individual Head-Related Transfer Functions (HRTFs) are starting to be introduced in many commercial immersive audio applications and are crucial for realistic spatial audio rendering. However, one of the main hesitations…

Retrieval-Augmented Neural Field for HRTF Upsampling and Personalization

2025-01-22 · Yoshiki Masuyama, Gordon Wichern, François G. Germain, Christopher Ick 외

Head-related transfer functions (HRTFs) with dense spatial grids are desired for immersive binaural audio generation, but their recording is time-consuming. Although HRTF spatial upsampling has shown remarkable progress …

Audio GenerationRetrievalTask 2

Denoising of photogrammetric dummy head ear point clouds for individual Head-Related Transfer Functions computation

2024-08-29 · Fabio Di Giusto, Francesc Lluís, Sjoerd van Ophem, Elke Deckers

Individual Head-Related Transfer Functions (HRTFs), crucial for realistic virtual audio rendering, can be efficiently numerically computed from precise three-dimensional head and ear scans. While photogrammetry scanning …

Denoising

Magnitude-Corrected and Time-Aligned Interpolation of Head-Related Transfer Functions

2023-03-17 · Johannes M. Arend, Christoph Pörschmann, Stefan Weinzierl, Fabian Brinkmann

Head-related transfer functions (HRTFs) are essential for virtual acoustic realities, as they contain all cues for localizing sound sources in three-dimensional space. Acoustic measurements are one way to obtain high-qua…

HRTF upsampling with a generative adversarial network using a gnomonic equiangular projection

2023-06-09 · Aidan O. T. Hogg, Mads Jenkins, He Liu, Isaac Squires 외

An individualised head-related transfer function (HRTF) is very important for creating realistic virtual reality (VR) and augmented reality (AR) environments. However, acoustically measuring high-quality HRTFs requires e…

Generative Adversarial NetworkSuper-Resolution