paper-with-me

홈 › Papers

GeoSurDepth: Harnessing Foundation Model for Spatial Geometry Consistency-Oriented Self-Supervised Surround-View Depth Estimation

2026-01-09 · Weimin Liu, Wenjun Wang, Joshua H. Meng arxiv

Accurate surround-view depth estimation provides a competitive alternative to laser-based sensors and is essential for 3D scene understanding in autonomous driving. While empirical studies have proposed various approaches that primarily focus on enforcing cross-view constraints at photometric level, few explicitly exploit the rich geometric structure inherent in both monocular and surround-view setting. In this work, we propose GeoSurDepth, a framework that leverages geometry consistency as the primary cue for surround-view depth estimation. Concretely, we utilize vision foundation models as pseudo geometry priors and feature representation enhancement tool to guide the network to maintain surface normal consistency in spatial 3D space and regularize object- and texture-consistent depth estimation in 2D. In addition, we introduce a novel view synthesis pipeline where 2D-3D lifting is achieved with dense depth reconstructed via spatial warping, encouraging additional photometric supervision across temporal and spatial contexts, and compensating for the limitations of target-view image reconstruction. Finally, a newly-proposed adaptive joint motion learning strategy enables the network to adaptively emphasize informative spatial geometry cues for improved motion reasoning. Extensive experiments on KITTI, DDAD and nuScenes demonstrate that GeoSurDepth achieves SoTA performance, validating the effectiveness of our approach. Our framework highlights the importance of exploiting geometry coherence and consistency for robust self-supervised depth estimation.

📄 PDF Abstract BibTeX arXiv:2601.05839

Code (0)

등록된 구현이 없습니다.

Tasks

Novel View SynthesisImage ReconstructionScene UnderstandingAutonomous Driving

Similar Papers 제목 키워드 기반

Geometry without Position? When Positional Embeddings Help and Hurt Spatial Reasoning

2026-01-29 · Jian Shi, Michael Birsak, Wenqing Cui, Zhenyu Li 외 arxiv

This paper revisits the role of positional embeddings (PEs) within vision transformers (ViTs) from a geometric perspective. We show that PEs are not mere token indices but effectively function as geometric priors that sh…

Spatial Reasoning

G$^2$TAM: Geometry Grounded Track Anything Model

2026-07-04 · Chenming Zhu, Peizhou Cao, Jingli Lin, Wenbo Hu 외 arxiv

Human spatial understanding arises from jointly perceiving geometry and semantics, enabling consistent object identification and localization across viewpoints and time. Current video segmentation models depend on explic…

Video Object SegmentationVideo SegmentationSpatial Reasoning3D Reconstruction

Learning 3D Representations for Spatial Intelligence from Unposed Multi-View Images

2026-04-12 · Bo Zhou, Qiuxia Lai, Zeren Sun, Xiangbo Shu 외 arxiv

Robust 3D representation learning forms the perceptual foundation of spatial intelligence, enabling downstream tasks in scene understanding and embodied AI. However, learning such representations directly from unposed mu…

Representation LearningScene Understanding

OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis

2026-03-20 · Jinglin Liang, Zijian Zhou, Rui Huang, Shuangping Huang 외 arxiv

Novel View Synthesis (NVS) aims to generate unseen views of a 3D object given a limited number of known views. Existing methods often struggle to synthesize plausible views for unobserved regions, particularly under sing…

Novel View SynthesisVideo Generation

FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry

2026-07-13 · Muxin Liu, Xiaoyang Lyu, Tianhe Ren, Peng Dai 외 arxiv

We present FoundationGeo, a two-stage framework that explicitly bridges relative and metric prediction via spatial calibration and principled data design. Stage 1 learns a high-fidelity, affine-invariant geometry model b…

Domain Generalization