Zero-Shot Monocular Motion Segmentation in the Wild by Combining Deep Learning with Geometric Motion Model Fusion
Detecting and segmenting moving objects from a moving monocular camera is challenging in the presence of unknown camera motion, diverse object motions and complex scene structures. Most existing methods rely on a single motion cue to perform motion segmentation, which is usually insufficient when facing different complex environments. While a few recent deep learning based methods are able to combine multiple motion cues to achieve improved accuracy, they depend heavily on vast datasets and extensive annotations, making them less adaptable to new scenarios. To address these limitations, we propose a novel monocular dense segmentation method that achieves state-of-the-art motion segmentation results in a zero-shot manner. The proposed method synergestically combines the strengths of deep learning and geometric model fusion methods by performing geometric model fusion on object proposals. Experiments show that our method achieves competitive results on several motion segmentation datasets and even surpasses some state-of-the-art supervised methods on certain benchmarks, while not being trained on any data. We also present an ablation study to show the effectiveness of combining different geometric models together for motion segmentation, highlighting the value of our geometric model fusion strategy.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion SegmentationSegmentationSimilar Papers 제목 키워드 기반
Robust 3D Shape Reconstruction in Zero-Shot from a Single Image in the Wild
Recent monocular 3D shape reconstruction methods have shown promising zero-shot results on object-segmented images without any occlusions. However, their effectiveness is significantly compromised in real-world condition…
3D Shape ReconstructionObjectSegmentationSemantic SegmentationWildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife
We introduce WildBox, a dataset and benchmark for monocular 3D detection of wildlife from drone video, comprising 237,505 3D bounding box annotations across seven African savanna species grouped into six benchmark classe…
NudgeSeg: Zero-Shot Object Segmentation by Repeated Physical Interaction
Recent advances in object segmentation have demonstrated that deep neural networks excel at object segmentation for specific classes in color and depth images. However, their performance is dictated by the number of clas…
Motion SegmentationObjectSegmentationSemantic SegmentationZero-Shot Monocular Scene Flow Estimation in the Wild
Large models have shown generalization across datasets for many low-level vision tasks, like depth estimation, but no such general models exist for scene flow. Even though scene flow has wide potential use, it is not use…
Depth EstimationPredictionScene Flow EstimationZero-shot GeneralizationPromptStereo: Zero-Shot Stereo Matching via Structure and Motion Prompts
Modern stereo matching methods have leveraged monocular depth foundation models to achieve superior zero-shot generalization performance. However, most existing methods primarily focus on extracting robust features for c…
Zero-shot Generalization