paper-with-me

Papers

SSFlowNet: Semi-supervised Scene Flow Estimation On Point Clouds With Pseudo Label

2023-12-23 · Jingze Chen, Junfeng Yao, Qiqin Lin, Rongzhou Zhou, Lei LI

In the domain of supervised scene flow estimation, the process of manual labeling is both time-intensive and financially demanding. This paper introduces SSFlowNet, a semi-supervised approach for scene flow estimation, that utilizes a blend of labeled and unlabeled data, optimizing the balance between the cost of labeling and the precision of model training. SSFlowNet stands out through its innovative use of pseudo-labels, mainly reducing the dependency on extensively labeled datasets while maintaining high model accuracy. The core of our model is its emphasis on the intricate geometric structures of point clouds, both locally and globally, coupled with a novel spatial memory feature. This feature is adept at learning the geometric relationships between points over sequential time frames. By identifying similarities between labeled and unlabeled points, SSFlowNet dynamically constructs a correlation matrix to evaluate scene flow dependencies at individual point level. Furthermore, the integration of a flow consistency module within SSFlowNet enhances its capability to consistently estimate flow, an essential aspect for analyzing dynamic scenes. Empirical results demonstrate that SSFlowNet surpasses existing methods in pseudo-label generation and shows adaptability across varying data volumes. Moreover, our semi-supervised training technique yields promising outcomes even with different smaller ratio labeled data, marking a substantial advancement in the field of scene flow estimation.

📄 PDF Abstract BibTeX arXiv:2312.15271

Code (0)

등록된 구현이 없습니다.

Tasks

Pseudo LabelScene Flow Estimation

Similar Papers 제목 키워드 기반

Self-Supervised Monocular Scene Flow Estimation

2020-04-08 · CVPR 2020 6 · Junhwa Hur, Stefan Roth

Scene flow estimation has been receiving increasing attention for 3D environment perception. Monocular scene flow estimation -- obtaining 3D structure and 3D motion from two temporally consecutive images -- is a highly i…

Depth EstimationMonocular Depth EstimationOptical Flow EstimationScene Flow Estimation+1

RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizer

2022-05-03 · Bayram Bayramli, Junhwa Hur, Hongtao Lu

Learning scene flow from a monocular camera still remains a challenging task due to its ill-posedness as well as lack of annotated data. Self-supervised methods demonstrate learning scene flow estimation from unlabeled d…

DecoderOptical Flow EstimationScene Flow Estimation

Deep learning based 2.5D flow field estimation for maximum intensity projections of 4D optical coherence tomography

2018-10-26 · Max-Heinrich Laves, Lüder A. Kahrs, Tobias Ortmaier

In microsurgery, lasers have emerged as precise tools for bone ablation. A challenge is automatic control of laser bone ablation with 4D optical coherence tomography (OCT). OCT as high resolution imaging modality provide…

Object TrackingOptical Flow EstimationScene Flow Estimation

Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation

2018-04-12 · ECCV 2018 9 · Zhaoyang Lv, Kihwan Kim, Alejandro Troccoli, Deqing Sun 외

Estimation of 3D motion in a dynamic scene from a temporal pair of images is a core task in many scene understanding problems. In real world applications, a dynamic scene is commonly captured by a moving camera (i.e., pa…

Optical Flow EstimationScene Flow EstimationScene Understanding

Unsupervised Learning of 3D Scene Flow from Monocular Camera

2022-06-08 · Guangming Wang, Xiaoyu Tian, Ruiqi Ding, Hesheng Wang

Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene …

Camera Pose EstimationDepth EstimationOptical Flow EstimationPose Estimation+1