paper-with-me

홈 › Papers

Self-Supervised 3D Scene Flow Estimation Guided by Superpoints

2023-05-04 · CVPR 2023 1 · Yaqi Shen, Le Hui, Jin Xie, Jian Yang

3D scene flow estimation aims to estimate point-wise motions between two consecutive frames of point clouds. Superpoints, i.e., points with similar geometric features, are usually employed to capture similar motions of local regions in 3D scenes for scene flow estimation. However, in existing methods, superpoints are generated with the offline clustering methods, which cannot characterize local regions with similar motions for complex 3D scenes well, leading to inaccurate scene flow estimation. To this end, we propose an iterative end-to-end superpoint based scene flow estimation framework, where the superpoints can be dynamically updated to guide the point-level flow prediction. Specifically, our framework consists of a flow guided superpoint generation module and a superpoint guided flow refinement module. In our superpoint generation module, we utilize the bidirectional flow information at the previous iteration to obtain the matching points of points and superpoint centers for soft point-to-superpoint association construction, in which the superpoints are generated for pairwise point clouds. With the generated superpoints, we first reconstruct the flow for each point by adaptively aggregating the superpoint-level flow, and then encode the consistency between the reconstructed flow of pairwise point clouds. Finally, we feed the consistency encoding along with the reconstructed flow into GRU to refine point-level flow. Extensive experiments on several different datasets show that our method can achieve promising performance.

📄 PDF Abstract BibTeX arXiv:2305.02528

Code (1)

supersyq/spflownet 공식 구현 pytorch

Tasks

Scene Flow Estimation

Methods 이 논문이 사용한 방법론

GRU A Gated Recurrent Unit, or GRU, is a type of recurrent neural network. It is similar to an LSTM, but only has two gates - a reset…

Similar Papers 제목 키워드 기반

Occlusion Guided Self-supervised Scene Flow Estimation on 3D Point Clouds

2021-04-10 · Bojun Ouyang, Dan Raviv

Understanding the flow in 3D space of sparsely sampled points between two consecutive time frames is the core stone of modern geometric-driven systems such as VR/AR, Robotics, and Autonomous driving. The lack of real, no…

Autonomous DrivingScene Flow EstimationSelf-supervised Scene Flow Estimation

Consistency Guided Scene Flow Estimation

2020-06-19 · ECCV 2020 8 · Yuhua Chen, Luc van Gool, Cordelia Schmid, Cristian Sminchisescu

Consistency Guided Scene Flow Estimation (CGSF) is a self-supervised framework for the joint reconstruction of 3D scene structure and motion from stereo video. The model takes two temporal stereo pairs as input, and pred…

Scene Flow Estimation

Adversarial Self-Supervised Scene Flow Estimation

2020-11-01 · Victor Zuanazzi, Joris van Vugt, Olaf Booij, Pascal Mettes

This work proposes a metric learning approach for self-supervised scene flow estimation. Scene flow estimation is the task of estimating 3D flow vectors for consecutive 3D point clouds. Such flow vectors are fruitful, \e…

Metric LearningScene Flow EstimationSelf-supervised Scene Flow EstimationTriplet

Self-supervised Learning of Occlusion Aware Flow Guided 3D Geometry Perception with Adaptive Cross Weighted Loss from Monocular Videos

2021-08-09 · Jiaojiao Fang, Guizhong Liu

Self-supervised deep learning-based 3D scene understanding methods can overcome the difficulty of acquiring the densely labeled ground-truth and have made a lot of advances. However, occlusions and moving objects are sti…

3D geometry3D Geometry PerceptionCamera Pose EstimationOptical Flow Estimation+3

Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation

2026-05-16 · Youngdong Jang, Gyeongrok Oh, Jong Wook Kim, Hyunju Ryu 외 arxiv

LiDAR scene flow estimation is essential for autonomous driving, as it provides 3D motion for each point. Self-supervised approaches use static-dynamic classification to mitigate the imbalance between static and dynamic …

Self-supervised Scene Flow EstimationAutonomous DrivingPoint Tracking