Robust Human Detection under Visual Degradation via Thermal and mmWave Radar Fusion
The majority of human detection methods rely on the sensor using visible lights (e.g., RGB cameras) but such sensors are limited in scenarios with degraded vision conditions. In this paper, we present a multimodal human detection system that combines portable thermal cameras and single-chip mmWave radars. To mitigate the noisy detection features caused by the low contrast of thermal cameras and the multi-path noise of radar point clouds, we propose a Bayesian feature extractor and a novel uncertainty-guided fusion method that surpasses a variety of competing methods, either single-modal or multi-modal. We evaluate the proposed method on real-world data collection and demonstrate that our approach outperforms the state-of-the-art methods by a large margin.
Code (1)
Tasks
Human DetectionSimilar Papers 제목 키워드 기반
HorusEye: Language as Dynamic Attention for Emergency Visual Analysis
We introduce HorusEye, Language as Dynamic Attention for Emergency Visual Analysis. Our investigation followed five stages. The first one is benchmarking RefCOCO-Degraded, a dataset of 15,244 images (3,811 base images x …
Visual GroundingDoes Thermal data make the detection systems more reliable?
Deep learning-based detection networks have made remarkable progress in autonomous driving systems (ADS). ADS should have reliable performance across a variety of ambient lighting and adverse weather conditions. However,…
Autonomous DrivingA Multimodal Dataset for Deception Detection
This paper presents the construction of a multimodal dataset for deception detection, including physiological, thermal, and visual responses of human subjects under three deceptive scenarios. We present the experimental …
Deception DetectionAutomated Thermal Screening for COVID-19 using Machine Learning
In the last two years, millions of lives have been lost due to COVID-19. Despite the vaccination programmes for a year, hospitalization rates and deaths are still high due to the new variants of COVID-19. Stringent guide…
BIG-bench Machine LearningSLAM in the Dark: Self-Supervised Learning of Pose, Depth and Loop-Closure from Thermal Images
Visual SLAM is essential for mobile robots, drone navigation, and VR/AR, but traditional RGB camera systems struggle in low-light conditions, driving interest in thermal SLAM, which excels in such environments. However, …
Depth EstimationDrone navigationLoop Closure DetectionSelf-Supervised Learning+1