paper-with-me

홈 › Papers

TopView: Vectorising road users in a bird's eye view from uncalibrated street-level imagery with deep learning

2024-12-18 · Mohamed R Ibrahim

Generating a bird's eye view of road users is beneficial for a variety of applications, including navigation, detecting agent conflicts, and measuring space occupancy, as well as the ability to utilise the metric system to measure distances between different objects. In this research, we introduce a simple approach for estimating a bird's eye view from images without prior knowledge of a given camera's intrinsic and extrinsic parameters. The model is based on the orthogonal projection of objects from various fields of view to a bird's eye view by learning the vanishing point of a given scene. Additionally, we utilised the learned vanishing point alongside the trajectory line to transform the 2D bounding boxes of road users into 3D bounding information. The introduced framework has been applied to several applications to generate a live Map from camera feeds and to analyse social distancing violations at the city scale. The introduced framework shows a high validation in geolocating road users in various uncalibrated cameras. It also paves the way for new adaptations in urban modelling techniques and simulating the built environment accurately, which could benefit Agent-Based Modelling by relying on deep learning and computer vision.

📄 PDF Abstract BibTeX arXiv:2412.16229

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LaRa: Latents and Rays for Multi-Camera Bird's-Eye-View Semantic Segmentation

2022-06-27 · Florent Bartoccioni, Éloi Zablocki, Andrei Bursuc, Patrick Pérez 외

Recent works in autonomous driving have widely adopted the bird's-eye-view (BEV) semantic map as an intermediate representation of the world. Online prediction of these BEV maps involves non-trivial operations such as mu…

Autonomous DrivingBird's-Eye View Semantic SegmentationDecoderDepth Estimation+2

TopViewRS: Vision-Language Models as Top-View Spatial Reasoners

2024-06-04 · Chengzu Li, Caiqi Zhang, Han Zhou, Nigel Collier 외

Top-view perspective denotes a typical way in which humans read and reason over different types of maps, and it is vital for localization and navigation of humans as well as of `non-human' agents, such as the ones backed…

Multiple-choiceSpatial Reasoning

Graph-SIM: A Graph-based Spatiotemporal Interaction Modelling for Pedestrian Action Prediction

2020-12-03 · Tiffany Yau, Saber Malekmohammadi, Amir Rasouli, Peter Lakner 외

One of the most crucial yet challenging tasks for autonomous vehicles in urban environments is predicting the future behaviour of nearby pedestrians, especially at points of crossing. Predicting behaviour depends on many…

Autonomous VehiclesClustering

Learning to Map Vehicles into Bird's Eye View

2017-06-26 · Andrea Palazzi, Guido Borghi, Davide Abati, Simone Calderara 외

Awareness of the road scene is an essential component for both autonomous vehicles and Advances Driver Assistance Systems and is gaining importance both for the academia and car companies. This paper presents a way to le…

Autonomous Vehicles

RoadBEV: Road Surface Reconstruction in Bird's Eye View

2024-04-09 · Tong Zhao, Lei Yang, Yichen Xie, Mingyu Ding 외

Road surface conditions, especially geometry profiles, enormously affect driving performance of autonomous vehicles. Vision-based online road reconstruction promisingly captures road information in advance. Existing solu…

Autonomous DrivingAutonomous VehiclesDepth EstimationMonocular Depth Estimation+2