Self-Supervised Scene Flow Estimation with 4-D Automotive Radar
Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely unknown how to estimate the scene flow from a 4-D radar - an increasingly popular automotive sensor for its robustness against adverse weather and lighting conditions. Compared with the LiDAR point clouds, radar data are drastically sparser, noisier and in much lower resolution. Annotated datasets for radar scene flow are also in absence and costly to acquire in the real world. These factors jointly pose the radar scene flow estimation as a challenging problem. This work aims to address the above challenges and estimate scene flow from 4-D radar point clouds by leveraging self-supervised learning. A robust scene flow estimation architecture and three novel losses are bespoken designed to cope with intractable radar data. Real-world experimental results validate that our method is able to robustly estimate the radar scene flow in the wild and effectively supports the downstream task of motion segmentation.
Code (2)
Tasks
Autonomous VehiclesMotion SegmentationScene Flow EstimationSelf-Supervised LearningSelf-supervised Scene Flow EstimationSimilar Papers 제목 키워드 기반
Adversarial Self-Supervised Scene Flow Estimation
This work proposes a metric learning approach for self-supervised scene flow estimation. Scene flow estimation is the task of estimating 3D flow vectors for consecutive 3D point clouds. Such flow vectors are fruitful, \e…
Metric LearningScene Flow EstimationSelf-supervised Scene Flow EstimationTripletSelf-Supervised Monocular Scene Flow Estimation
Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly i…
Depth EstimationMonocular Depth EstimationOptical Flow EstimationScene Flow Estimation+1R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes
While self-supervised monocular depth estimation in driving scenarios has achieved comparable performance to supervised approaches, violations of the static world assumption can still lead to erroneous depth predictions …
Autonomous VehiclesDepth EstimationMonocular Depth EstimationDo not trust the neighbors! Adversarial Metric Learning for Self-Supervised Scene Flow Estimation
Scene flow is the task of estimating 3D motion vectors to individual points of a dynamic 3D scene. Motion vectors have shown to be beneficial for downstream tasks such as action classification and collision avoidance. Ho…
Action ClassificationCollision AvoidanceMetric LearningScene Flow Estimation+2$\mathrm{F^2Depth}$: Self-supervised Indoor Monocular Depth Estimation via Optical Flow Consistency and Feature Map Synthesis
Self-supervised monocular depth estimation methods have been increasingly given much attention due to the benefit of not requiring large, labelled datasets. Such self-supervised methods require high-quality salient featu…
Depth EstimationIndoor Monocular Depth EstimationMonocular Depth EstimationOptical Flow Estimation+1