"If you could see me through my eyes": Predicting Pedestrian Perception
Pedestrians are particularly vulnerable road users in urban traffic. With the arrival of autonomous driving, novel technologies can be developed specifically to protect pedestrians. We propose a machine learning toolchain to train artificial neural networks as models of pedestrian behavior. In a preliminary study, we use synthetic data from simulations of a specific pedestrian crossing scenario to train a variational autoencoder and a long short-term memory network to predict a pedestrian's future visual perception. We can accurately predict a pedestrian's future perceptions within relevant time horizons. By iteratively feeding these predicted frames into these networks, they can be used as simulations of pedestrians as indicated by our results. Such trained networks can later be used to predict pedestrian behaviors even from the perspective of the autonomous car. Another future extension will be to re-train these networks with real-world video data.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
STINet: Spatio-Temporal-Interactive Network for Pedestrian Detection and Trajectory Prediction
Detecting pedestrians and predicting future trajectories for them are critical tasks for numerous applications, such as autonomous driving. Previous methods either treat the detection and prediction as separate tasks or …
3D geometryAutonomous Drivingobject-detectionObject Detection+2Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms
Advances in face swapping have enabled the automatic generation of highly realistic faces. Yet face swaps are perceived differently than when looking at real faces, with key differences in viewer behavior surrounding the…
DeepFake DetectionFace SwappingGaze EstimationA pedestrian path-planning model in accordance with obstacle's danger with reinforcement learning
Most microscopic pedestrian navigation models use the concept of "forces" applied to the pedestrian agents to replicate the navigation environment. While the approach could provide believable results in regular situation…
Collision Avoidancereinforcement-learningReinforcement LearningReinforcement Learning (RL)Estimation of crowd density applying wavelet transform and machine learning
We conducted a simple experiment in which one pedestrian passed through a crowded area and measured the body-rotational angular velocity with commercial tablets. Then, we developed a new method for predicting crowd densi…
BIG-bench Machine LearningManagementPIP-Net: Pedestrian Intention Prediction in the Wild
Accurate pedestrian intention prediction (PIP) by Autonomous Vehicles (AVs) is one of the current research challenges in this field. In this article, we introduce PIP-Net, a novel framework designed to predict pedestrian…
Autonomous VehiclesPrediction