paper-with-me

Papers

Fast Neural Scene Flow

2023-04-18 · ICCV 2023 1 · Xueqian Li, Jianqiao Zheng, Francesco Ferroni, Jhony Kaesemodel Pontes, Simon Lucey

Neural Scene Flow Prior (NSFP) is of significant interest to the vision community due to its inherent robustness to out-of-distribution (OOD) effects and its ability to deal with dense lidar points. The approach utilizes a coordinate neural network to estimate scene flow at runtime, without any training. However, it is up to 100 times slower than current state-of-the-art learning methods. In other applications such as image, video, and radiance function reconstruction innovations in speeding up the runtime performance of coordinate networks have centered upon architectural changes. In this paper, we demonstrate that scene flow is different -- with the dominant computational bottleneck stemming from the loss function itself (i.e., Chamfer distance). Further, we rediscover the distance transform (DT) as an efficient, correspondence-free loss function that dramatically speeds up the runtime optimization. Our fast neural scene flow (FNSF) approach reports for the first time real-time performance comparable to learning methods, without any training or OOD bias on two of the largest open autonomous driving (AV) lidar datasets Waymo Open and Argoverse.

📄 PDF Abstract BibTeX arXiv:2304.09121

Code (1)

lilac-lee/fastnsf 공식 구현 pytorch

Tasks

Autonomous DrivingScene Flow EstimationSelf-supervised Scene Flow Estimation

Similar Papers 제목 키워드 기반

OptFlow: Fast Optimization-based Scene Flow Estimation without Supervision

2024-01-04 · WACV 2024 1 · Rahul Ahuja, Chris Baker, Wilko Schwarting

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based sc…

Autonomous DrivingPoint Cloud RegistrationScene Flow EstimationSelf-supervised Scene Flow Estimation+1

Fast Multi-frame Stereo Scene Flow with Motion Segmentation

2017-07-05 · CVPR 2017 7 · Tatsunori Taniai, Sudipta N. Sinha, Yoichi Sato

We propose a new multi-frame method for efficiently computing scene flow (dense depth and optical flow) and camera ego-motion for a dynamic scene observed from a moving stereo camera rig. Our technique also segments out …

CPUMotion SegmentationOptical Flow EstimationStereo Matching+2

SceneFlowFields++: Multi-frame Matching, Visibility Prediction, and Robust Interpolation for Scene Flow Estimation

2019-02-26 · René Schuster, Oliver Wasenmüller, Christian Unger, Georg Kuschk 외

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of sce…

Scene Flow Estimation

Factorized Motion Fields for Fast Sparse Input Dynamic View Synthesis

2024-04-17 · Nagabhushan Somraj, Kapil Choudhary, Sai Harsha Mupparaju, Rajiv Soundararajan

Designing a 3D representation of a dynamic scene for fast optimization and rendering is a challenging task. While recent explicit representations enable fast learning and rendering of dynamic radiance fields, they requir…

FastPCI: Motion-Structure Guided Fast Point Cloud Frame Interpolation

2024-10-25 · Tianyu Zhang, Guocheng Qian, Jin Xie, Jian Yang

Point cloud frame interpolation is a challenging task that involves accurate scene flow estimation across frames and maintaining the geometry structure. Prevailing techniques often rely on pre-trained motion estimators o…

Scene Flow Estimation