Task-conditioned Domain Adaptation for Pedestrian Detection in Thermal Imagery
Pedestrian detection is a core problem in computer vision that sees broad application in video surveillance and, more recently, in advanced driving assistance systems. Despite its broad application and interest, it remains a challenging problem in part due to the vast range of conditions under which it must be robust. Pedestrian detection at nighttime and during adverse weather conditions is particularly challenging, which is one of the reasons why thermal and multispectral approaches have been become popular in recent years. In this paper, we propose a novel approach to domain adaptation that significantly improves pedestrian detection performance in the thermal domain. The key idea behind our technique is to adapt an RGB-trained detection network to simultaneously solve two related tasks. An auxiliary classification task that distinguishes between daytime and nighttime thermal images is added to the main detection task during domain adaptation. The internal representation learned to perform this classification task is used to condition a YOLOv3 detector at multiple points in order to improve its adaptation to the thermal domain. We validate the effectiveness of task-conditioned domain adaptation by comparing with the state-of-the-art on the KAIST Multispectral Pedestrian Detection Benchmark. To the best of our knowledge, our proposed task-conditioned approach achieves the best single-modality detection results.
Code (1)
Tasks
Domain AdaptationPedestrian DetectionSimilar Papers 제목 키워드 기반
Unsupervised Deep Domain Adaptation for Pedestrian Detection
This paper addresses the problem of unsupervised domain adaptation on the task of pedestrian detection in crowded scenes. First, we utilize an iterative algorithm to iteratively select and auto-annotate positive pedestri…
Domain AdaptationPedestrian DetectionUnsupervised Domain AdaptationUnsupervised Domain Adaptation for Multispectral Pedestrian Detection
Multimodal information (e.g., visible and thermal) can generate robust pedestrian detections to facilitate around-the-clock computer vision applications, such as autonomous driving and video surveillance. However, it sti…
Autonomous DrivingDomain AdaptationPedestrian DetectionUnsupervised Domain AdaptationRobust pedestrian detection in thermal imagery using synthesized images
In this paper we propose a method for improving pedestrian detection in the thermal domain using two stages: first, a generative data augmentation approach is used, then a domain adaptation method using generated data ad…
Data AugmentationDomain AdaptationGenerative Adversarial NetworkPedestrian DetectionDeep Multi-Task Networks For Occluded Pedestrian Pose Estimation
Most of the existing works on pedestrian pose estimation do not consider estimating the pose of an occluded pedestrian, as the annotations of the occluded parts are not available in relevant automotive datasets. For exam…
Domain AdaptationInstance SegmentationPedestrian DetectionPose Estimation+2MVUDA: Unsupervised Domain Adaptation for Multi-view Pedestrian Detection
We address multi-view pedestrian detection in a setting where labeled data is collected using a multi-camera setup different from the one used for testing. While recent multi-view pedestrian detectors perform well on the…
Domain AdaptationPedestrian DetectionUnsupervised Domain Adaptation