paper-with-me

홈 › Papers

Data-driven 3D Room Geometry Inference with a Linear Loudspeaker Array and a Single Microphone

2023-08-28 · Cagdas Tuna, Altan Akat, H. Nazim Bicer, Andreas Walther, Emanuël A. P. Habets

Knowing the room geometry may be very beneficial for many audio applications, including sound reproduction, acoustic scene analysis, and sound source localization. Room geometry inference (RGI) deals with the problem of reflector localization (RL) based on a set of room impulse responses (RIRs). Motivated by the increasing popularity of commercially available soundbars, this article presents a data-driven 3D RGI method using RIRs measured from a linear loudspeaker array to a single microphone. A convolutional recurrent neural network (CRNN) is trained using simulated RIRs in a supervised fashion for RL. The Radon transform, which is equivalent to delay-and-sum beamforming, is applied to multi-channel RIRs, and the resulting time-domain acoustic beamforming map is fed into the CRNN. The room geometry is inferred from the microphone position and the reflector locations estimated by the network. The results obtained using measured RIRs show that the proposed data-driven approach generalizes well to unseen RIRs and achieves an accuracy level comparable to a baseline model-driven RGI method that involves intermediate semi-supervised steps, thereby offering a unified and fully automated RGI framework.

📄 PDF Abstract BibTeX arXiv:2308.14611

Code (0)

등록된 구현이 없습니다.

Tasks

Sound Source Localization

Similar Papers 제목 키워드 기반

RGI-Net: 3D Room Geometry Inference from Room Impulse Responses With Hidden First-Order Reflections

2023-09-04 · Inmo Yeon, Jung-Woo Choi

Room geometry is important prior information for implementing realistic 3D audio rendering. For this reason, various room geometry inference (RGI) methods have been developed by utilizing the time-of-arrival (TOA) or tim…

Data-driven Joint Detection and Localization of Acoustic Reflectors

2024-02-09 · H. Nazim Bicer, Cagdas Tuna, Andreas Walther, Emanuël A. P. Habets

Room geometry inference algorithms rely on the localization of acoustic reflectors to identify boundary surfaces of an enclosure. Rooms with highly absorptive walls or walls at large distances from the measurement setup …

3D Room Geometry Inference from Multichannel Room Impulse Response using Deep Neural Network

2024-01-19 · Inmo Yeon, Jung-Woo Choi

Room geometry inference (RGI) aims at estimating room shapes from measured room impulse responses (RIRs) and has received lots of attention for its importance in environment-aware audio rendering and virtual acoustic rep…

parameter estimation

Pano2CAD: Room Layout From A Single Panorama Image

2016-09-29 · Jiu Xu, Bjorn Stenger, Tommi Kerola, Tony Tung

This paper presents a method of estimating the geometry of a room and the 3D pose of objects from a single 360-degree panorama image. Assuming Manhattan World geometry, we formulate the task as a Bayesian inference probl…

2D Object DetectionBayesian InferenceObjectobject-detection+3

RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture

2023-05-18 · Liangchen Song, Liangliang Cao, Hongyu Xu, Kai Kang 외

The techniques for 3D indoor scene capturing are widely used, but the meshes produced leave much to be desired. In this paper, we propose "RoomDreamer", which leverages powerful natural language to synthesize a new room …

Image GenerationIndoor Scene Synthesis