Audio-Based Pedestrian Detection in the Presence of Vehicular Noise
Audio-based pedestrian detection is a challenging task and has, thus far, only been explored in noise-limited environments. We present a new dataset, results, and a detailed analysis of the state-of-the-art in audio-based pedestrian detection in the presence of vehicular noise. In our study, we conduct three analyses: (i) cross-dataset evaluation between noisy and noise-limited environments, (ii) an assessment of the impact of noisy data on model performance, highlighting the influence of acoustic context, and (iii) an evaluation of the model's predictive robustness on out-of-domain sounds. The new dataset is a comprehensive 1321-hour roadside dataset. It incorporates traffic-rich soundscapes. Each recording includes 16kHz audio synchronized with frame-level pedestrian annotations and 1fps video thumbnails.
Code (0)
등록된 구현이 없습니다.
Tasks
Pedestrian DetectionSimilar Papers 제목 키워드 기반
Understanding Pedestrian Movement Using Urban Sensing Technologies: The Promise of Audio-based Sensors
While various sensors have been deployed to monitor vehicular flows, sensing pedestrian movement is still nascent. Yet walking is a significant mode of travel in many cities, especially those in Europe, Africa, and Asia.…
ASPED: An Audio Dataset for Detecting Pedestrians
We introduce the new audio analysis task of pedestrian detection and present a new large-scale dataset for this task. While the preliminary results prove the viability of using audio approaches for pedestrian detection, …
Pedestrian DetectionDroneAudioset: An Audio Dataset for Drone-based Search and Rescue
Unmanned Aerial Vehicles (UAVs) or drones, are increasingly used in search and rescue missions to detect human presence. Existing systems primarily leverage vision-based methods which are prone to fail under low-visibili…
Is Audio Spoof Detection Robust to Laundering Attacks?
Voice-cloning (VC) systems have seen an exceptional increase in the realism of synthesized speech in recent years. The high quality of synthesized speech and the availability of low-cost VC services have given rise to ma…
Voice CloningJoint Pedestrian and Vehicle Traffic Optimization in Urban Environments using Reinforcement Learning
Reinforcement learning (RL) holds significant promise for adaptive traffic signal control. While existing RL-based methods demonstrate effectiveness in reducing vehicular congestion, their predominant focus on vehicle-ce…
Reinforcement Learning (RL)Traffic Signal Control