SSA-CNN: Semantic Self-Attention CNN for Pedestrian Detection
Pedestrian detection plays an important role in many applications such as autonomous driving. We propose a method that explores semantic segmentation results as self-attention cues to significantly improve the pedestrian detection performance. Specifically, a multi-task network is designed to jointly learn semantic segmentation and pedestrian detection from image datasets with weak box-wise annotations. The semantic segmentation feature maps are concatenated with corresponding convolution features maps to provide more discriminative features for pedestrian detection and pedestrian classification. By jointly learning segmentation and detection, our proposed pedestrian self-attention mechanism can effectively identify pedestrian regions and suppress backgrounds. In addition, we propose to incorporate semantic attention information from multi-scale layers into deep convolution neural network to boost pedestrian detection. Experiment results show that the proposed method achieves the best detection performance with MR of 6.27% on Caltech dataset and obtain competitive performance on CityPersons dataset while maintaining high computational efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingComputational EfficiencyPedestrian DetectionSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VLPD: Context-Aware Pedestrian Detection via Vision-Language Semantic Self-Supervision
Detecting pedestrians accurately in urban scenes is significant for realistic applications like autonomous driving or video surveillance. However, confusing human-like objects often lead to wrong detections, and small sc…
Autonomous DrivingPedestrian DetectionContrastive-SDXL: Annotation-Preserving Night-Time Augmentation for Pedestrian Detection
Night-time pedestrian detection remains challenging because labelled night-time data are limited and large illumination differences make daytime-only trained detectors unreliable. Latent diffusion models (LDMs) provide a…
Image-to-Image TranslationSemantic correspondencePedestrian DetectionBright Channel Prior Attention for Multispectral Pedestrian Detection
Multispectral methods have gained considerable attention due to their promising performance across various fields. However, most existing methods cannot effectively utilize information from two modalities while optimizin…
Image Enhancementobject-detectionObject DetectionPedestrian DetectionFeature Calibration Network for Occluded Pedestrian Detection
Pedestrian detection in the wild remains a challenging problem especially for scenes containing serious occlusion. In this paper, we propose a novel feature learning method in the deep learning framework, referred to as …
Pedestrian DetectionFusion of Multispectral Data Through Illumination-aware Deep Neural Networks for Pedestrian Detection
Multispectral pedestrian detection has received extensive attention in recent years as a promising solution to facilitate robust human target detection for around-the-clock applications (e.g. security surveillance and au…
Autonomous DrivingMultispectral Object DetectionMulti-Task LearningPedestrian Detection+1