Stereo Anything: Unifying Stereo Matching with Large-Scale Mixed Data
Stereo matching has been a pivotal component in 3D vision, aiming to find corresponding points between pairs of stereo images to recover depth information. In this work, we introduce StereoAnything, a highly practical solution for robust stereo matching. Rather than focusing on a specialized model, our goal is to develop a versatile foundational model capable of handling stereo images across diverse environments. To this end, we scale up the dataset by collecting labeled stereo images and generating synthetic stereo pairs from unlabeled monocular images. To further enrich the model's ability to generalize across different conditions, we introduce a novel synthetic dataset that complements existing data by adding variability in baselines, camera angles, and scene types. We extensively evaluate the zero-shot capabilities of our model on five public datasets, showcasing its impressive ability to generalize to new, unseen data. Code will be available at \url{https://github.com/XiandaGuo/OpenStereo}.
Code (1)
Tasks
Stereo MatchingSimilar Papers 제목 키워드 기반
UniTT-Stereo: Unified Training of Transformer for Enhanced Stereo Matching
Unlike other vision tasks where Transformer-based approaches are becoming increasingly common, stereo depth estimation is still dominated by convolution-based approaches. This is mainly due to the limited availability of…
Depth EstimationInductive BiasSelf-Supervised LearningStereo Depth Estimation+1SyntStereo2Real: Edge-Aware GAN for Remote Sensing Image-to-Image Translation while Maintaining Stereo Constraint
In the field of remote sensing, the scarcity of stereo-matched and particularly lack of accurate ground truth data often hinders the training of deep neural networks. The use of synthetically generated images as an alter…
Autonomous DrivingDomain GeneralizationImage-to-Image TranslationStereo Matching+1LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching
Existing Vision Foundation Model (VFM)-based iterative stereo pipelines under-exploit three information pathways: multi-scale backbone features are collapsed into single-level correlations, geometric priors remain untapp…
Domain GeneralizationPVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matching
Supervised learning with deep convolutional neural networks (DCNNs) has seen huge adoption in stereo matching. However, the acquisition of large-scale datasets with well-labeled ground truth is cumbersome and labor-inten…
Stereo MatchingUnifying Flow, Stereo and Depth Estimation
We present a unified formulation and model for three motion and 3D perception tasks: optical flow, rectified stereo matching and unrectified stereo depth estimation from posed images. Unlike previous specialized architec…
Depth EstimationOptical Flow EstimationStereo Depth EstimationStereo Matching