Enhancing Event-based Object Detection with Monocular Normal Maps
Object detection in autonomous driving is frequently compromised by complex illumination. While event cameras offer a robust solution, they are susceptible to sudden contrast changes such as reflections which often trigger dense, misleading event signals. To overcome this, we leverage RGB-derived surface normal maps as explicit geometric constraints. Crucially, even when RGB degrades, they preserve low-frequency structural priors that effectively assist in event-based detection. Consequently, we present NRE-Net, a trimodal framework that integrates structural priors from surface Normal maps, appearance context from RGB images, and high-frequency dynamics from Events. The Adaptive Dual-stream Fusion Module (ADFM) first aligns geometric and appearance cues, followed by the Event-modality Aware Fusion Module (EAFM) which selectively integrates event dynamics. Extensive evaluations on DSEC-Det-sub and PKU-DAVIS-SOD demonstrate that incorporating geometric priors yields an additional 3.0% AP50 gain over dual-modal baselines, while our approach consistently outperforms fusion methods such as SFNet (+2.7%) and SODFormer (+7.1%).
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingObject DetectionSimilar Papers 제목 키워드 기반
Distance-Normalized Unified Representation for Monocular 3D Object Detection
Monocular 3D object detection plays an important role in autonomous driving and still remains challenging. To achieve fast and accurate monocular 3D object detection, we introduce a single-stage and multi-scale framework…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+2MonoUNI: A Unified Vehicle and Infrastructure-side Monocular 3D Object Detection Network with Sufficient Depth Clues
Monocular 3D detection of vehicle and infrastructure sides are two important topics in autonomous driving. Due to diverse sensor installations and focal lengths, researchers are faced with the challenge of constructing a…
3D Object DetectionAutonomous DrivingMonocular 3D Object Detectionobject-detection+1Towards Generalization Across Depth for Monocular 3D Object Detection
While expensive LiDAR and stereo camera rigs have enabled the development of successful 3D object detection methods, monocular RGB-only approaches lag much behind. This work advances the state of the art by introducing M…
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoders
Monocular 3D object detection aims for precise 3D localization and identification of objects from a single-view image. Despite its recent progress, it often struggles while handling pervasive object occlusions that tend …
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1WeakM3D: Towards Weakly Supervised Monocular 3D Object Detection
Monocular 3D object detection is one of the most challenging tasks in 3D scene understanding. Due to the ill-posed nature of monocular imagery, existing monocular 3D detection methods highly rely on training with the man…
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+3