paper-with-me

홈 › Papers

Audio scene monitoring using redundant ad-hoc microphone array networks

2021-03-02 · Peter Gerstoft, Yihan Hu, Michael J. Bianco, Chaitanya Patil, Ardel Alegre, Yoav Freund, Francois Grondin

We present a system for localizing sound sources in a room with several ad-hoc microphone arrays. Each circular array performs direction of arrival (DOA) estimation independently using commercial software. The DOAs are fed to a fusion center, concatenated, and used to perform the localization based on two proposed methods, which require only few labeled source locations (anchor points) for training. The first proposed method is based on principal component analysis (PCA) of the observed DOA and does not require any knowledge of anchor points. The array cluster can then perform localization on a manifold defined by the PCA of concatenated DOAs over time. The second proposed method performs localization using an affine transformation between the DOA vectors and the room manifold. The PCA has fewer requirements on the training sequence, but is less robust to missing DOAs from one of the arrays. The methods are demonstrated with five IoT 8-microphone circular arrays, placed at unspecified fixed locations in an office. Both the PCA and the affine method can easily map out a rectangle based on a few anchor points with similar accuracy. The proposed methods provide a step towards monitoring activities in a smart home and require little installation effort as the array locations are not needed.

📄 PDF Abstract BibTeX arXiv:2103.01830

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Attention-based distributed speech enhancement for unconstrained microphone arrays with varying number of nodes

2021-06-15 · Nicolas Furnon, Romain Serizel, Slim Essid, Irina Illina

Speech enhancement promises higher efficiency in ad-hoc microphone arrays than in constrained microphone arrays thanks to the wide spatial coverage of the devices in the acoustic scene. However, speech enhancement in ad-…

Speech Enhancement

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

2023-06-15 · NeurIPS 2023 11 · Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam, Daniel Krause 외

While direction of arrival (DOA) of sound events is generally estimated from multichannel audio data recorded in a microphone array, sound events usually derive from visually perceptible source objects, e.g., sounds of f…

Sound Event Localization and Detection

Neural Ambisonics encoding for compact irregular microphone arrays

2024-01-11 · Mikko Heikkinen, Archontis Politis, Tuomas Virtanen

Ambisonics encoding of microphone array signals can enable various spatial audio applications, such as virtual reality or telepresence, but it is typically designed for uniformly-spaced spherical microphone arrays. This …

Cooperative Audio Source Separation and Enhancement Using Distributed Microphone Arrays and Wearable Devices

2019-12-10

Augmented listening devices such as hearing aids often perform poorly in noisy and reverberant environments with many competing sound sources. Large distributed microphone arrays can improve performance, but data from re…

Audio Source Separation

Leveraging Acoustic Images for Effective Self-Supervised Audio Representation Learning

2020-08-01 · ECCV 2020 8 · Valentina Sanguineti, Pietro Morerio, Niccolò Pozzetti, Danilo Greco 외

In this paper, we propose the use of a new modality characterized by a richer information content, namely acoustic images, for the sake of audio-visual scene understanding. Each pixel in such images is characterized by a…

Cross-Modal RetrievalRepresentation LearningRetrievalScene Understanding+1