paper-with-me

홈 › Papers

"If you could see me through my eyes": Predicting Pedestrian Perception

2022-02-28 · Julian Petzold, Mostafa Wahby, Franek Stark, Ulrich Behrje, Heiko Hamann

Pedestrians are particularly vulnerable road users in urban traffic. With the arrival of autonomous driving, novel technologies can be developed specifically to protect pedestrians. We propose a machine learning toolchain to train artificial neural networks as models of pedestrian behavior. In a preliminary study, we use synthetic data from simulations of a specific pedestrian crossing scenario to train a variational autoencoder and a long short-term memory network to predict a pedestrian's future visual perception. We can accurately predict a pedestrian's future perceptions within relevant time horizons. By iteratively feeding these predicted frames into these networks, they can be used as simulations of pedestrians as indicated by our results. Such trained networks can later be used to predict pedestrian behaviors even from the perspective of the autonomous car. Another future extension will be to re-train these networks with real-world video data.

📄 PDF Abstract BibTeX arXiv:2202.13981

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Methods 이 논문이 사용한 방법론

Memory Network 설명 없음

Similar Papers 제목 키워드 기반

STINet: Spatio-Temporal-Interactive Network for Pedestrian Detection and Trajectory Prediction

2020-05-08 · CVPR 2020 6 · Zhishuai Zhang, Jiyang Gao, Junhua Mao, Yukai Liu 외

Detecting pedestrians and predicting future trajectories for them are critical tasks for numerous applications, such as autonomous driving. Previous methods either treat the detection and prediction as separate tasks or …

3D geometryAutonomous Drivingobject-detectionObject Detection+2

Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms

2024-02-05 · Ethan Wilson, Frederick Shic, Sophie Jörg, Eakta Jain

Advances in face swapping have enabled the automatic generation of highly realistic faces. Yet face swaps are perceived differently than when looking at real faces, with key differences in viewer behavior surrounding the…

DeepFake DetectionFace SwappingGaze Estimation

A pedestrian path-planning model in accordance with obstacle's danger with reinforcement learning

2019-12-06 · Thanh-Trung Trinh, Dinh-Minh Vu, Masaomi Kimura

Most microscopic pedestrian navigation models use the concept of "forces" applied to the pedestrian agents to replicate the navigation environment. While the approach could provide believable results in regular situation…

Collision Avoidancereinforcement-learningReinforcement LearningReinforcement Learning (RL)

Estimation of crowd density applying wavelet transform and machine learning

2019-03-19 · Koki Nagao, Daichi Yanagisawa, Katsuhiro Nishinari

We conducted a simple experiment in which one pedestrian passed through a crowded area and measured the body-rotational angular velocity with commercial tablets. Then, we developed a new method for predicting crowd densi…

BIG-bench Machine LearningManagement

PIP-Net: Pedestrian Intention Prediction in the Wild

2024-02-20 · Mohsen Azarmi, Mahdi Rezaei, He Wang, Sebastien Glaser

Accurate pedestrian intention prediction (PIP) by Autonomous Vehicles (AVs) is one of the current research challenges in this field. In this article, we introduce PIP-Net, a novel framework designed to predict pedestrian…

Autonomous VehiclesPrediction