Fast Kernel Scene Flow
In contrast to current state-of-the-art methods, such as NSFP [25], which employ deep implicit neural functions for modeling scene flow, we present a novel approach that utilizes classical kernel representations. This representation enables our approach to effectively handle dense lidar points while demonstrating exceptional computational efficiency -- compared to recent deep approaches -- achieved through the solution of a linear system. As a runtime optimization-based method, our model exhibits impressive generalizability across various out-of-distribution scenarios, achieving competitive performance on large-scale lidar datasets. We propose a new positional encoding-based kernel that demonstrates state-of-the-art performance in efficient lidar scene flow estimation on large-scale point clouds. An important highlight of our method is its near real-time performance (~150-170 ms) with dense lidar data (~8k-144k points), enabling a variety of practical applications in robotics and autonomous driving scenarios.
Code (1)
Tasks
8kAutonomous DrivingComputational EfficiencyScene Flow EstimationSimilar Papers 제목 키워드 기반
Video Deblurring via Semantic Segmentation and Pixel-Wise Non-Linear Kernel
Video deblurring is a challenging problem as the blur is complex and usually caused by the combination of camera shakes, object motions, and depth variations. Optical flow can be used for kernel estimation since it predi…
DeblurringOptical Flow EstimationSemantic SegmentationVideo DeblurringOptFlow: Fast Optimization-based Scene Flow Estimation without Supervision
Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based sc…
Autonomous DrivingPoint Cloud RegistrationScene Flow EstimationSelf-supervised Scene Flow Estimation+1Fast Multi-frame Stereo Scene Flow with Motion Segmentation
We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out …
CPUMotion SegmentationOptical Flow EstimationStereo Matching+2Fast, Robust, Continuous Monocular Egomotion Computation
We propose robust methods for estimating camera egomotion in noisy, real-world monocular image sequences in the general case of unknown observer rotation and translation with two views and a small baseline. This is a dif…
counterfactualMotion EstimationOptical Flow EstimationTranslationSceneFlowFields++: Multi-frame Matching, Visibility Prediction, and Robust Interpolation for Scene Flow Estimation
State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of sce…
Scene Flow Estimation