Localized Semantic Feature Mixers for Efficient Pedestrian Detection in Autonomous Driving
Autonomous driving systems rely heavily on the underlying perception module which needs to be both performant and efficient to allow precise decisions in real-time. Avoiding collisions with pedestrians is of topmost priority in any autonomous driving system. Therefore, pedestrian detection is one of the core parts of such systems' perception modules. Current state-of-the-art pedestrian detectors have two major issues. Firstly, they have long inference times which affect the efficiency of the whole perception module, and secondly, their performance in the case of small and heavily occluded pedestrians is poor. We propose Localized Semantic Feature Mixers (LSFM), a novel, anchor-free pedestrian detection architecture. It uses our novel Super Pixel Pyramid Pooling module instead of the, computationally costly, Feature Pyramid Networks for feature encoding. Moreover, our MLPMixer-based Dense Focal Detection Network is used as a light detection head, reducing computational effort and inference time compared to existing approaches. To boost the performance of the proposed architecture, we adapt and use mixup augmentation which improves the performance, especially in small and heavily occluded cases. We benchmark LSFM against the state-of-the-art on well-established traffic scene pedestrian datasets. The proposed LSFM achieves state-of-the-art performance in Caltech, City Persons, Euro City Persons, and TJU-Traffic-Pedestrian datasets while reducing the inference time on average by 55%. Further, LSFM beats the human baseline for the first time in the history of pedestrian detection. Finally, we conducted a cross-dataset evaluation which proved that our proposed LSFM generalizes well to unseen data.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingPedestrian DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SSA-CNN: Semantic Self-Attention CNN for Pedestrian Detection
Pedestrian detection plays an important role in many applications such as autonomous driving. We propose a method that explores semantic segmentation results as self-attention cues to significantly improve the pedestrian…
Autonomous DrivingComputational EfficiencyPedestrian DetectionSegmentation+1Semantic Channels for Fast Pedestrian Detection
Pedestrian detection and semantic segmentation are high potential tasks for many real-time applications. However most of the top performing approaches provide state of art results at high computational costs. In this wor…
CPUGPUPedestrian DetectionSegmentation+1High-Level Semantic Feature Detection: A New Perspective for Pedestrian Detection
Object detection generally requires sliding-window classifiers in tradition or anchor-based predictions in modern deep learning approaches. However, either of these approaches requires tedious configurations in windows o…
object-detectionObject DetectionPedestrian DetectionVocal Bursts Intensity PredictionIlluminating Pedestrians via Simultaneous Detection & Segmentation
Pedestrian detection is a critical problem in computer vision with significant impact on safety in urban autonomous driving. In this work, we explore how semantic segmentation can be used to boost pedestrian detection ac…
Autonomous DrivingPedestrian DetectionSegmentationSemantic SegmentationAttribute-aware Pedestrian Detection in a Crowd
Pedestrian detection is an initial step to perform outdoor scene analysis, which plays an essential role in many real-world applications. Although having enjoyed the merits of deep learning frameworks from the generic ob…
AttributePedestrian Detection