paper-with-me

홈 › Papers

Scalable Scene Flow from Point Clouds in the Real World

2021-03-01 · Philipp Jund, Chris Sweeney, Nichola Abdo, Zhifeng Chen, Jonathon Shlens

Autonomous vehicles operate in highly dynamic environments necessitating an accurate assessment of which aspects of a scene are moving and where they are moving to. A popular approach to 3D motion estimation, termed scene flow, is to employ 3D point cloud data from consecutive LiDAR scans, although such approaches have been limited by the small size of real-world, annotated LiDAR data. In this work, we introduce a new large-scale dataset for scene flow estimation derived from corresponding tracked 3D objects, which is $\sim$1,000$\times$ larger than previous real-world datasets in terms of the number of annotated frames. We demonstrate how previous works were bounded based on the amount of real LiDAR data available, suggesting that larger datasets are required to achieve state-of-the-art predictive performance. Furthermore, we show how previous heuristics for operating on point clouds such as down-sampling heavily degrade performance, motivating a new class of models that are tractable on the full point cloud. To address this issue, we introduce the FastFlow3D architecture which provides real time inference on the full point cloud. Additionally, we design human-interpretable metrics that better capture real world aspects by accounting for ego-motion and providing breakdowns per object type. We hope that this dataset may provide new opportunities for developing real world scene flow systems.

📄 PDF Abstract BibTeX arXiv:2103.01306

Code (5)

jabb0/fastflow3d pytorch
kth-rpl/deflow pytorch
kylevedder/zeroflow pytorch
leolyj/dca-srsfe pytorch
tudelft-iv/voteflow pytorch

Tasks

Autonomous VehiclesMotion EstimationScene Flow Estimation

Similar Papers 제목 키워드 기반

ZeroFlow: Scalable Scene Flow via Distillation

2023-05-17 · Kyle Vedder, Neehar Peri, Nathaniel Chodosh, Ishan Khatri 외

Scene flow estimation is the task of describing the 3D motion field between temporally successive point clouds. State-of-the-art methods use strong priors and test-time optimization techniques, but require on the order o…

Scene Flow EstimationSelf-supervised Scene Flow Estimation

FlowNet3D: Learning Scene Flow in 3D Point Clouds

2018-06-04 · CVPR 2019 6 · Xingyu Liu, Charles R. Qi, Leonidas J. Guibas

Many applications in robotics and human-computer interaction can benefit from understanding 3D motion of points in a dynamic environment, widely noted as scene flow. While most previous methods focus on stereo and RGB-D …

Motion Segmentation

3DSFLabelling: Boosting 3D Scene Flow Estimation by Pseudo Auto-labelling

2024-02-28 · CVPR 2024 1 · Chaokang Jiang, Guangming Wang, Jiuming Liu, Hesheng Wang 외

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real spars…

Autonomous DrivingData AugmentationScene Flow Estimation

Scene Flow from Point Clouds with or without Learning

2020-10-31 · Jhony Kaesemodel Pontes, James Hays, Simon Lucey

Scene flow is the three-dimensional (3D) motion field of a scene. It provides information about the spatial arrangement and rate of change of objects in dynamic environments. Current learning-based approaches seek to est…

Motion SegmentationSelf-Supervised Learning

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

2022-09-27 · Chaokang Jiang, Guangming Wang, Yanzi Miao, Hesheng Wang

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The pre…

Optical Flow EstimationScene Flow EstimationSelf-Supervised Learning