paper-with-me

Papers

Zero-Shot Monocular Motion Segmentation in the Wild by Combining Deep Learning with Geometric Motion Model Fusion

2024-05-02 · Yuxiang Huang, Yuhao Chen, John Zelek

Detecting and segmenting moving objects from a moving monocular camera is challenging in the presence of unknown camera motion, diverse object motions and complex scene structures. Most existing methods rely on a single motion cue to perform motion segmentation, which is usually insufficient when facing different complex environments. While a few recent deep learning based methods are able to combine multiple motion cues to achieve improved accuracy, they depend heavily on vast datasets and extensive annotations, making them less adaptable to new scenarios. To address these limitations, we propose a novel monocular dense segmentation method that achieves state-of-the-art motion segmentation results in a zero-shot manner. The proposed method synergestically combines the strengths of deep learning and geometric model fusion methods by performing geometric model fusion on object proposals. Experiments show that our method achieves competitive results on several motion segmentation datasets and even surpasses some state-of-the-art supervised methods on certain benchmarks, while not being trained on any data. We also present an ablation study to show the effectiveness of combining different geometric models together for motion segmentation, highlighting the value of our geometric model fusion strategy.

📄 PDF Abstract BibTeX arXiv:2405.01723

Code (0)

등록된 구현이 없습니다.

Tasks

Motion SegmentationSegmentation

Similar Papers 제목 키워드 기반

Robust 3D Shape Reconstruction in Zero-Shot from a Single Image in the Wild

2024-03-21 · CVPR 2025 1 · Junhyeong Cho, Kim Youwang, Hunmin Yang, Tae-Hyun Oh

Recent monocular 3D shape reconstruction methods have shown promising zero-shot results on object-segmented images without any occlusions. However, their effectiveness is significantly compromised in real-world condition…

3D Shape ReconstructionObjectSegmentationSemantic Segmentation

WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife

2026-06-19 · Vandita Shukla, Kilian Meier, Lucie Laporte-Devylder, Camille Rondeau Saint-Jean 외 arxiv

We introduce WildBox, a dataset and benchmark for monocular 3D detection of wildlife from drone video, comprising 237,505 3D bounding box annotations across seven African savanna species grouped into six benchmark classe…

NudgeSeg: Zero-Shot Object Segmentation by Repeated Physical Interaction

2021-09-22 · Chahat Deep Singh, Nitin J. Sanket, Chethan M. Parameshwara, Cornelia Fermüller 외

Recent advances in object segmentation have demonstrated that deep neural networks excel at object segmentation for specific classes in color and depth images. However, their performance is dictated by the number of clas…

Motion SegmentationObjectSegmentationSemantic Segmentation

Zero-Shot Monocular Scene Flow Estimation in the Wild

2025-01-17 · CVPR 2025 1 · Yiqing Liang, Abhishek Badki, Hang Su, James Tompkin 외

Large models have shown generalization across datasets for many low-level vision tasks, like depth estimation, but no such general models exist for scene flow. Even though scene flow has wide potential use, it is not use…

Depth EstimationPredictionScene Flow EstimationZero-shot Generalization

PromptStereo: Zero-Shot Stereo Matching via Structure and Motion Prompts

2026-03-02 · Xianqi Wang, Hao Yang, Hangtian Wang, Junda Cheng 외 arxiv

Modern stereo matching methods have leveraged monocular depth foundation models to achieve superior zero-shot generalization performance. However, most existing methods primarily focus on extracting robust features for c…

Zero-shot Generalization