Box-level Segmentation Supervised Deep Neural Networks for Accurate and Real-time Multispectral Pedestrian Detection
Effective fusion of complementary information captured by multi-modal sensors (visible and infrared cameras) enables robust pedestrian detection under various surveillance situations (e.g. daytime and nighttime). In this paper, we present a novel box-level segmentation supervised learning framework for accurate and real-time multispectral pedestrian detection by incorporating features extracted in visible and infrared channels. Specifically, our method takes pairs of aligned visible and infrared images with easily obtained bounding box annotations as input and estimates accurate prediction maps to highlight the existence of pedestrians. It offers two major advantages over the existing anchor box based multispectral detection methods. Firstly, it overcomes the hyperparameter setting problem occurred during the training phase of anchor box based detectors and can obtain more accurate detection results, especially for small and occluded pedestrian instances. Secondly, it is capable of generating accurate detection results using small-size input images, leading to improvement of computational efficiency for real-time autonomous driving applications. Experimental results on KAIST multispectral dataset show that our proposed method outperforms state-of-the-art approaches in terms of both accuracy and speed.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingComputational EfficiencyPedestrian DetectionSimilar Papers 제목 키워드 기반
Weakly Supervised 3D Semantic Segmentation Using Cross-Image Consensus and Inter-Voxel Affinity Relations
We propose a novel weakly supervised approach for 3D semantic segmentation on volumetric images. Unlike most existing methods that require voxel-wise densely labeled training data, our weakly-supervised CIVA-Net is t…
3D Semantic SegmentationSegmentationSemantic SegmentationDiscriminative Localization in CNNs for Weakly-Supervised Segmentation of Pulmonary Nodules
Automated detection and segmentation of pulmonary nodules on lung computed tomography (CT) scans can facilitate early lung cancer diagnosis. Existing supervised approaches for automated nodule segmentation on CT scans re…
Computed Tomography (CT)General Classificationimage-classificationImage Classification+3Weakly-Supervised Universal Lesion Segmentation with Regional Level Set Loss
Accurately segmenting a variety of clinically significant lesions from whole body computed tomography (CT) scans is a critical task on precision oncology imaging, denoted as universal lesion segmentation (ULS). Manual an…
Computed Tomography (CT)DecoderLesion SegmentationSegmentation+1Bootstrapping the Performance of Webly Supervised Semantic Segmentation
Fully supervised methods for semantic segmentation require pixel-level class masks to train, the creation of which are expensive in terms of manual labour and time. In this work, we focus on weak supervision, developing …
SegmentationSemantic SegmentationTransfer LearningWeakly supervised Semantic Segmentation+1SPARS: Self-Play Adversarial Reinforcement Learning for Segmentation of Liver Tumours
Accurate tumour segmentation is vital for various targeted diagnostic and therapeutic procedures for cancer, e.g., planning biopsies or tumour ablations. Manual delineation is extremely labour-intensive, requiring substa…
DiagnosticSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation