paper-with-me

Papers

Neural Semantic Map-Learning for Autonomous Vehicles

2024-10-10 · Markus Herb, Nassir Navab, Federico Tombari

Autonomous vehicles demand detailed maps to maneuver reliably through traffic, which need to be kept up-to-date to ensure a safe operation. A promising way to adapt the maps to the ever-changing road-network is to use crowd-sourced data from a fleet of vehicles. In this work, we present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment including drivable area, lane markings, poles, obstacles and more as a 3D mesh. Each vehicle contributes locally reconstructed submaps as lightweight meshes, making our method applicable to a wide range of reconstruction methods and sensor modalities. Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field, which is supervised using the submap meshes to predict a fused environment representation. We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction. Our approach is evaluated on two datasets with different local mapping methods, showing improved pose alignment and reconstruction over existing methods. Additionally, we demonstrate the benefit of multi-session mapping and examine the required amount of data to enable high-fidelity map learning for autonomous vehicles.

📄 PDF Abstract BibTeX arXiv:2410.07780

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles

Similar Papers 제목 키워드 기반

AVP-SLAM: Semantic Visual Mapping and Localization for Autonomous Vehicles in the Parking Lot

2020-07-03 · Tong Qin, Tongqing Chen, Yilun Chen, Qing Su

Autonomous valet parking is a specific application for autonomous vehicles. In this task, vehicles need to navigate in narrow, crowded and GPS-denied parking lots. Accurate localization ability is of great importance. Tr…

Autonomous VehiclesNavigate

Real-time 3D semantic occupancy prediction for autonomous vehicles using memory-efficient sparse convolution

2024-03-13 · Samuel Sze, Lars Kunze

In autonomous vehicles, understanding the surrounding 3D environment of the ego vehicle in real-time is essential. A compact way to represent scenes while encoding geometric distances and semantic object information is v…

3D Semantic Occupancy Prediction3D Semantic SegmentationAutonomous DrivingAutonomous Vehicles+2

RoadMap: A Light-Weight Semantic Map for Visual Localization towards Autonomous Driving

2021-06-04 · Tong Qin, Yuxin Zheng, Tongqing Chen, Yilun Chen 외

Accurate localization is of crucial importance for autonomous driving tasks. Nowadays, we have seen a lot of sensor-rich vehicles (e.g. Robo-taxi) driving on the street autonomously, which rely on high-accurate sensors (…

Autonomous DrivingVisual Localization

CoFF: Cooperative Spatial Feature Fusion for 3D Object Detection on Autonomous Vehicles

2020-09-24 · Jingda Guo, Dominic Carrillo, Sihai Tang, Qi Chen 외

To reduce the amount of transmitted data, feature map based fusion is recently proposed as a practical solution to cooperative 3D object detection by autonomous vehicles. The precision of object detection, however, may r…

3D Object DetectionAutonomous VehiclesObjectobject-detection+1

MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes

2017-12-14 · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2017 12 · Qishen Ha, Kohei Watanabe, Takumi Karasawa, Yoshitaka Ushiku 외

This work addresses the semantic segmentation of images of street scenes for autonomous vehicles based on a new RGB-Thermal dataset, which is also introduced in this paper. An increasing interest in self-driving vehicles…

Autonomous VehiclesImage SegmentationReal-Time Semantic SegmentationSegmentation+2