RGI-Net: 3D Room Geometry Inference from Room Impulse Responses With Hidden First-Order Reflections
Room geometry is important prior information for implementing realistic 3D audio rendering. For this reason, various room geometry inference (RGI) methods have been developed by utilizing the time-of-arrival (TOA) or time-difference-of-arrival (TDOA) information in room impulse responses (RIRs). However, the conventional RGI technique poses several assumptions, such as convex room shapes, the number of walls known in priori, and the visibility of first-order reflections. In this work, we introduce the RGI-Net which can estimate room geometries without the aforementioned assumptions. RGI-Net learns and exploits complex relationships between low-order and high-order reflections in RIRs and, thus, can estimate room shapes even when the shape is non-convex or first-order reflections are missing in the RIRs. RGI-Net includes the evaluation network that separately evaluates the presence probability of walls, so the geometry inference is possible without prior knowledge of the number of walls.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Room Geometry Estimation from Room Impulse Responses using Convolutional Neural Networks
We describe a new method to estimate the geometry of a room given room impulse responses. The method utilises convolutional neural networks to estimate the room geometry and uses the mean square error as the loss functio…
PositionRoom Impulse Response (RIR)3D Room Geometry Inference from Multichannel Room Impulse Response using Deep Neural Network
Room geometry inference (RGI) aims at estimating room shapes from measured room impulse responses (RIRs) and has received lots of attention for its importance in environment-aware audio rendering and virtual acoustic rep…
parameter estimationdEchorate: a Calibrated Room Impulse Response Database for Echo-aware Signal Processing
This paper presents dEchorate: a new database of measured multichannel Room Impulse Responses (RIRs) including annotations of early echo timings and 3D positions of microphones, real sources and image sources under diffe…
BenchmarkingRetrievalRoom Impulse Response (RIR)Speech EnhancementData-driven 3D Room Geometry Inference with a Linear Loudspeaker Array and a Single Microphone
Knowing the room geometry may be very beneficial for many audio applications, including sound reproduction, acoustic scene analysis, and sound source localization. Room geometry inference (RGI) deals with the problem of …
Sound Source LocalizationOWL: Geometry-Aware Spatial Reasoning for Audio Large Language Models
Spatial reasoning is fundamental to auditory perception, yet current audio large language models (ALLMs) largely rely on unstructured binaural cues and single step inference. This limits both perceptual accuracy in direc…
Spatial Reasoning