Hearing What You Cannot See: Acoustic Vehicle Detection Around Corners
This work proposes to use passive acoustic perception as an additional sensing modality for intelligent vehicles. We demonstrate that approaching vehicles behind blind corners can be detected by sound before such vehicles enter in line-of-sight. We have equipped a research vehicle with a roof-mounted microphone array, and show on data collected with this sensor setup that wall reflections provide information on the presence and direction of occluded approaching vehicles. A novel method is presented to classify if and from what direction a vehicle is approaching before it is visible, using as input Direction-of-Arrival features that can be efficiently computed from the streaming microphone array data. Since the local geometry around the ego-vehicle affects the perceived patterns, we systematically study several environment types, and investigate generalization across these environments. With a static ego-vehicle, an accuracy of 0.92 is achieved on the hidden vehicle classification task. Compared to a state-of-the-art visual detector, Faster R-CNN, our pipeline achieves the same accuracy more than one second ahead, providing crucial reaction time for the situations we study. While the ego-vehicle is driving, we demonstrate positive results on acoustic detection, still achieving an accuracy of 0.84 within one environment type. We further study failure cases across environments to identify future research directions.
Code (1)
Tasks
vehicle detectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PitchBench: Measuring Pitch Hearing in Audio-Language Models
Audio-language models (ALMs) are increasingly used in real-world applications that require understanding music, from music tutoring and transcription to captioning, recommendation systems, and music production. More broa…
Recommendation SystemsModels of signal processing in human hearing
The paper presents a theoretical system model of the monaural signal processing in the human auditory system. Moreover, it deals with the application of this hearing model to the calculation of just-noticeable amplitude…
Effect of laboratory conditions on the perception of virtual stages for music
This manuscript presents initial findings critical for supporting augmented acoustics experiments in custom-made hearing booths, addressing a key challenge in ensuring perceptual validity and experimental rigor in these …
Improving the Environmental Perception of Autonomous Vehicles using Deep Learning-based Audio Classification
Sense of hearing is crucial for autonomous vehicles (AVs) to better perceive its surrounding environment. Although visual sensors of an AV, such as camera, lidar, and radar, help to see its surrounding environment, an AV…
Audio ClassificationAutonomous VehiclesClassificationThe Spatial Selective Auditory Attention of Cochlear Implant Users in Different Conversational Sound Levels
In multi speakers environments, cochlear implant (CI) users may attend to a target sound source in a different manner from the normal hearing (NH) individuals during a conversation. This study attempted to investigate th…
EEGElectroencephalogram (EEG)speech-recognitionSpeech Recognition