MegaFlow: Zero-Shot Large Displacement Optical Flow
Accurate estimation of large displacement optical flow remains a critical challenge. Existing methods typically rely on iterative local search or/and domain-specific fine-tuning, which severely limits their performance in large displacement and zero-shot generalization scenarios. To overcome this, we introduce MegaFlow, a simple yet powerful model for zero-shot large displacement optical flow. Rather than relying on highly complex, task-specific architectural designs, MegaFlow adapts powerful pre-trained vision priors to produce temporally consistent motion fields. In particular, we formulate flow estimation as a global matching problem by leveraging pre-trained global Vision Transformer features, which naturally capture large displacements. This is followed by a few lightweight iterative refinements to further improve the sub-pixel accuracy. Extensive experiments demonstrate that MegaFlow achieves state-of-the-art zero-shot performance across multiple optical flow benchmarks. Moreover, our model also delivers highly competitive zero-shot performance on long-range point tracking benchmarks, demonstrating its robust transferability and suggesting a unified paradigm for generalizable motion estimation. Our project page is at: https://kristen-z.github.io/projects/megaflow.
Code (0)
등록된 구현이 없습니다.
Tasks
Zero-shot GeneralizationPoint TrackingSimilar Papers 제목 키워드 기반
PanMatch: Unleashing the Potential of Large Vision Models for Unified Matching Models
This work presents PanMatch, a versatile foundation model for robust correspondence matching. Unlike previous methods that rely on task-specific architectures and domain-specific fine-tuning to support tasks like stereo …
Design and implementation of the net zero displacement filter for the synthesis of a mechanical shock signal under specified shock response spectrum
Electronic and optical products are vulnerable under mechanical shock environment. Designed products need to be validated by shock testing and/or numerical simulation, using representative acceleration-time history signa…
Large Displacement Optical Flow from Nearest Neighbor Fields
We present an optical flow algorithm for large displacement motions. Most existing optical flow methods use the standard coarse-to-fine framework to deal with large displacement motions which has intrinsic limitations. I…
Motion EstimationMotion SegmentationOptical Flow EstimationSegmentationFALDOI: A new minimization strategy for large displacement variational optical flow
We propose a large displacement optical flow method that introduces a new strategy to compute a good local minimum of any optical flow energy functional. The method requires a given set of discrete matches, which can be …
Optical Flow EstimationA Network for structural dense displacement based on 3D deformable mesh model and optical flow
This study proposes a Network to recognize displacement of a RC frame structure from a video by a monocular camera. The proposed Network consists of two modules which is FlowNet2 and POFRN-Net. FlowNet2 is used to genera…
Optical Flow Estimation