paper-with-me

홈 › Papers

Hearing What You Cannot See: Acoustic Vehicle Detection Around Corners

2020-07-30 · Yannick Schulz, Avinash Kini Mattar, Thomas M. Hehn, Julian F. P. Kooij

This work proposes to use passive acoustic perception as an additional sensing modality for intelligent vehicles. We demonstrate that approaching vehicles behind blind corners can be detected by sound before such vehicles enter in line-of-sight. We have equipped a research vehicle with a roof-mounted microphone array, and show on data collected with this sensor setup that wall reflections provide information on the presence and direction of occluded approaching vehicles. A novel method is presented to classify if and from what direction a vehicle is approaching before it is visible, using as input Direction-of-Arrival features that can be efficiently computed from the streaming microphone array data. Since the local geometry around the ego-vehicle affects the perceived patterns, we systematically study several environment types, and investigate generalization across these environments. With a static ego-vehicle, an accuracy of 0.92 is achieved on the hidden vehicle classification task. Compared to a state-of-the-art visual detector, Faster R-CNN, our pipeline achieves the same accuracy more than one second ahead, providing crucial reaction time for the situations we study. While the ego-vehicle is driving, we demonstrate positive results on acoustic detection, still achieving an accuracy of 0.84 within one environment type. We further study failure cases across environments to identify future research directions.

📄 PDF Abstract BibTeX arXiv:2007.15739

Code (1)

tudelft-iv/occluded_vehicle_acoustic_detection

Tasks

vehicle detection

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

PitchBench: Measuring Pitch Hearing in Audio-Language Models

2026-05-25 · Milan Liessens Dujardin, Song-Ze Yu, Craver Corbyn Thomas-Smith, David M. Chan 외 arxiv

Audio-language models (ALMs) are increasingly used in real-world applications that require understanding music, from music tutoring and transcription to captioning, recommendation systems, and music production. More broa…

Recommendation Systems

Models of signal processing in human hearing

2005-06-09 · AEU - International Journal of Electronics and Communications 2005 6 · Roland Sottek∗, Klaus Genuit

The paper presents a theoretical system model of the monaural signal processing in the human auditory system. Moreover, it deals with the application of this hearing model to the calculation of just-noticeable amplitude…

Effect of laboratory conditions on the perception of virtual stages for music

2025-05-26 · Ernesto Accolti

This manuscript presents initial findings critical for supporting augmented acoustics experiments in custom-made hearing booths, addressing a key challenge in ensuring perceptual validity and experimental rigor in these …

Improving the Environmental Perception of Autonomous Vehicles using Deep Learning-based Audio Classification

2022-09-09 · Finley Walden, Sagar Dasgupta, Mizanur Rahman, Mhafuzul Islam

Sense of hearing is crucial for autonomous vehicles (AVs) to better perceive its surrounding environment. Although visual sensors of an AV, such as camera, lidar, and radar, help to see its surrounding environment, an AV…

Audio ClassificationAutonomous VehiclesClassification

The Spatial Selective Auditory Attention of Cochlear Implant Users in Different Conversational Sound Levels

2021-03-03 · Sara Akbarzadeh, Sungmin Lee, Chin-Tuan Tan

In multi speakers environments, cochlear implant (CI) users may attend to a target sound source in a different manner from the normal hearing (NH) individuals during a conversation. This study attempted to investigate th…

EEGElectroencephalogram (EEG)speech-recognitionSpeech Recognition