A Pedestrian Detection and Tracking Framework for Autonomous Cars: Efficient Fusion of Camera and LiDAR Data
This paper presents a novel method for pedestrian detection and tracking by fusing camera and LiDAR sensor data. To deal with the challenges associated with the autonomous driving scenarios, an integrated tracking and detection framework is proposed. The detection phase is performed by converting LiDAR streams to computationally tractable depth images, and then, a deep neural network is developed to identify pedestrian candidates both in RGB and depth images. To provide accurate information, the detection phase is further enhanced by fusing multi-modal sensor information using the Kalman filter. The tracking phase is a combination of the Kalman filter prediction and an optical flow algorithm to track multiple pedestrians in a scene. We evaluate our framework on a real public driving dataset. Experimental results demonstrate that the proposed method achieves significant performance improvement over a baseline method that solely uses image-based pedestrian detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingOptical Flow EstimationPedestrian DetectionSimilar Papers 제목 키워드 기반
Pedestrian Models for Autonomous Driving Part I: Low-Level Models, from Sensing to Tracking
Autonomous vehicles (AVs) must share space with pedestrians, both in carriageway cases such as cars at pedestrian crossings and off-carriageway cases such as delivery vehicles navigating through crowds on pedestrianized …
Autonomous DrivingAutonomous VehiclesPedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behavior
Autonomous vehicles (AVs) must share space with pedestrians, both in carriageway cases such as cars at pedestrian crossings and off-carriageway cases such as delivery vehicles navigating through crowds on pedestrianized …
Autonomous DrivingAutonomous VehiclesDescriptiveTrack, then Decide: Category-Agnostic Vision-based Multi-Object Tracking
The most common paradigm for vision-based multi-object tracking is tracking-by-detection, due to the availability of reliable detectors for several important object categories such as cars and pedestrians. However, futur…
Image SegmentationMulti-Object TrackingObjectObject Tracking+2Pedestrian Emergence Estimation and Occlusion-Aware Risk Assessment for Urban Autonomous Driving
Avoiding unseen or partially occluded vulnerable road users (VRUs) is a major challenge for fully autonomous driving in urban scenes. However, occlusion-aware risk assessment systems have not been widely studied. Here, w…
Autonomous DrivingA Review of Tracking, Prediction and Decision Making Methods for Autonomous Driving
This literature review focuses on three important aspects of an autonomous car system: tracking (assessing the identity of the actors such as cars, pedestrians or obstacles in a sequence of observations), prediction (pre…
Autonomous DrivingDecision MakingDeep Reinforcement LearningNavigate+4