paper-with-me

Papers

Scene Flow from Point Clouds with or without Learning

2020-10-31 · Jhony Kaesemodel Pontes, James Hays, Simon Lucey

Scene flow is the three-dimensional (3D) motion field of a scene. It provides information about the spatial arrangement and rate of change of objects in dynamic environments. Current learning-based approaches seek to estimate the scene flow directly from point clouds and have achieved state-of-the-art performance. However, supervised learning methods are inherently domain specific and require a large amount of labeled data. Annotation of scene flow on real-world point clouds is expensive and challenging, and the lack of such datasets has recently sparked interest in self-supervised learning methods. How to accurately and robustly learn scene flow representations without labeled real-world data is still an open problem. Here we present a simple and interpretable objective function to recover the scene flow from point clouds. We use the graph Laplacian of a point cloud to regularize the scene flow to be "as-rigid-as-possible". Our proposed objective function can be used with or without learning---as a self-supervisory signal to learn scene flow representations, or as a non-learning-based method in which the scene flow is optimized during runtime. Our approach outperforms related works in many datasets. We also show the immediate applications of our proposed method for two applications: motion segmentation and point cloud densification.

📄 PDF Abstract BibTeX arXiv:2011.00320

Code (0)

등록된 구현이 없습니다.

Tasks

Motion SegmentationSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Learning Scene Flow in 3D Point Clouds with Noisy Pseudo Labels

2022-03-23 · Bing Li, Cheng Zheng, Guohao Li, Bernard Ghanem

We propose a novel scene flow method that captures 3D motions from point clouds without relying on ground-truth scene flow annotations. Due to the irregularity and sparsity of point clouds, it is expensive and time-consu…

Pseudo LabelSelf-Supervised Learning

HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Clouds

2019-06-12 · CVPR 2019 6 · Xiuye Gu, Yijie Wang, Chongruo wu, Yong-Jae lee 외

We present a novel deep neural network architecture for end-to-end scene flow estimation that directly operates on large-scale 3D point clouds. Inspired by Bilateral Convolutional Layers (BCL), we propose novel DownBCL, …

Scene Flow Estimation

3DSFLabelling: Boosting 3D Scene Flow Estimation by Pseudo Auto-labelling

2024-02-28 · CVPR 2024 1 · Chaokang Jiang, Guangming Wang, Jiuming Liu, Hesheng Wang 외

Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real spars…

Autonomous DrivingData AugmentationScene Flow Estimation

RMS-FlowNet: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Clouds

2022-04-01 · Ramy Battrawy, René Schuster, Mohammad-Ali Nikouei Mahani, Didier Stricker

The proposed RMS-FlowNet is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation which can operate on point clouds of high density. For hierarchical scene flow estimation, the e…

Scene Flow Estimation

EgoFlowNet: Non-Rigid Scene Flow from Point Clouds with Ego-Motion Support

2024-07-03 · Ramy Battrawy, René Schuster, Didier Stricker

Recent weakly-supervised methods for scene flow estimation from LiDAR point clouds are limited to explicit reasoning on object-level. These methods perform multiple iterative optimizations for each rigid object, which ma…

ClusteringObjectScene Flow Estimation