DEFLOW: Self-supervised 3D Motion Estimation of Debris Flow
Existing work on scene flow estimation focuses on autonomous driving and mobile robotics, while automated solutions are lacking for motion in nature, such as that exhibited by debris flows. We propose DEFLOW, a model for 3D motion estimation of debris flows, together with a newly captured dataset. We adopt a novel multi-level sensor fusion architecture and self-supervision to incorporate the inductive biases of the scene. We further adopt a multi-frame temporal processing module to enable flow speed estimation over time. Our model achieves state-of-the-art optical flow and depth estimation on our dataset, and fully automates the motion estimation for debris flows. The source code and dataset are available at project page.
Code (1)
Tasks
Autonomous DrivingDepth EstimationMotion EstimationOptical Flow EstimationScene Flow EstimationSensor FusionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DeFlow: Decoder of Scene Flow Network in Autonomous Driving
Scene flow estimation determines a scene's 3D motion field, by predicting the motion of points in the scene, especially for aiding tasks in autonomous driving. Many networks with large-scale point clouds as input use vox…
Autonomous DrivingDecoderScene Flow EstimationStructure from Motion-based Motion Estimation and 3D Reconstruction of Unknown Shaped Space Debris
With the boost in the number of spacecraft launches in the current decades, the space debris problem is daily becoming significantly crucial. For sustainable space utilization, the continuous removal of space debris is t…
3D ReconstructionMotion EstimationGuideFlow: Constraint-Guided Flow Matching for Planning in End-to-End Autonomous Driving
Driving planning is a critical component of end-to-end (E2E) autonomous driving. However, prevailing Imitative E2E Planners often suffer from multimodal trajectory mode collapse, failing to produce diverse trajectory pro…
Autonomous DrivingCodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation
Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes. We formalize this iterative, multi-tu…
Code GenerationDeFlow: Learning Complex Image Degradations from Unpaired Data with Conditional Flows
The difficulty of obtaining paired data remains a major bottleneck for learning image restoration and enhancement models for real-world applications. Current strategies aim to synthesize realistic training data by modeli…
DecoderImage RestorationSuper-Resolution