paper-with-me

홈 › Papers

Self-Supervised Bird's Eye View Motion Prediction with Cross-Modality Signals

2024-01-21 · Shaoheng Fang, Zuhong Liu, Mingyu Wang, Chenxin Xu, Yiqi Zhong, Siheng Chen

Learning the dense bird's eye view (BEV) motion flow in a self-supervised manner is an emerging research for robotics and autonomous driving. Current self-supervised methods mainly rely on point correspondences between point clouds, which may introduce the problems of fake flow and inconsistency, hindering the model's ability to learn accurate and realistic motion. In this paper, we introduce a novel cross-modality self-supervised training framework that effectively addresses these issues by leveraging multi-modality data to obtain supervision signals. We design three innovative supervision signals to preserve the inherent properties of scene motion, including the masked Chamfer distance loss, the piecewise rigidity loss, and the temporal consistency loss. Through extensive experiments, we demonstrate that our proposed self-supervised framework outperforms all previous self-supervision methods for the motion prediction task.

📄 PDF Abstract BibTeX arXiv:2401.11499

Code (1)

bshfang/self-supervised-motion 공식 구현 pytorch

Tasks

Autonomous Drivingmotion prediction

Similar Papers 제목 키워드 기반

ViewBirdiformer: Learning to recover ground-plane crowd trajectories and ego-motion from a single ego-centric view

2022-10-12 · Mai Nishimura, Shohei Nobuhara, Ko Nishino

We introduce a novel learning-based method for view birdification, the task of recovering ground-plane trajectories of pedestrians of a crowd and their observer in the same crowd just from the observed ego-centric video.…

Robot Navigation

DLWM: Dual Latent World Models enable Holistic Gaussian-centric Pre-training in Autonomous Driving

2026-04-01 · Yiyao Zhu, Ying Xue, Haiming Zhang, Guangfeng Jiang 외 arxiv

Vision-based autonomous driving has gained much attention due to its low costs and excellent performance. Compared with dense BEV (Bird's Eye View) or sparse query models, Gaussian-centric method is a comprehensive yet s…

Autonomous DrivingMotion Planning

OccFeat: Self-supervised Occupancy Feature Prediction for Pretraining BEV Segmentation Networks

2024-04-22 · Sophia Sirko-Galouchenko, Alexandre Boulch, Spyros Gidaris, Andrei Bursuc 외

We introduce a self-supervised pretraining method, called OccFeat, for camera-only Bird's-Eye-View (BEV) segmentation networks. With OccFeat, we pretrain a BEV network via occupancy prediction and feature distillation ta…

BEV SegmentationPredictionSegmentationSemantic Segmentation

BEVScope: Enhancing Self-Supervised Depth Estimation Leveraging Bird's-Eye-View in Dynamic Scenarios

2023-06-20 · Yucheng Mao, Ruowen Zhao, Tianbao Zhang, Hang Zhao

Depth estimation is a cornerstone of perception in autonomous driving and robotic systems. The considerable cost and relatively sparse data acquisition of LiDAR systems have led to the exploration of cost-effective alter…

Autonomous DrivingDepth Estimation

Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3D

2020-08-13 · ECCV 2020 8 · Jonah Philion, Sanja Fidler

The goal of perception for autonomous vehicles is to extract semantic representations from multiple sensors and fuse these representations into a single "bird's-eye-view" coordinate frame for consumption by motion planni…

Autonomous VehiclesBird's-Eye View Semantic SegmentationMotion PlanningSemantic Segmentation