paper-with-me

Papers

Depth-aware Volume Attention for Texture-less Stereo Matching

2024-02-14 · Tong Zhao, Mingyu Ding, Wei Zhan, Masayoshi Tomizuka, Yintao Wei

Stereo matching plays a crucial role in 3D perception and scenario understanding. Despite the proliferation of promising methods, addressing texture-less and texture-repetitive conditions remains challenging due to the insufficient availability of rich geometric and semantic information. In this paper, we propose a lightweight volume refinement scheme to tackle the texture deterioration in practical outdoor scenarios. Specifically, we introduce a depth volume supervised by the ground-truth depth map, capturing the relative hierarchy of image texture. Subsequently, the disparity discrepancy volume undergoes hierarchical filtering through the incorporation of depth-aware hierarchy attention and target-aware disparity attention modules. Local fine structure and context are emphasized to mitigate ambiguity and redundancy during volume aggregation. Furthermore, we propose a more rigorous evaluation metric that considers depth-wise relative error, providing comprehensive evaluations for universal stereo matching and depth estimation models. We extensively validate the superiority of our proposed methods on public datasets. Results demonstrate that our model achieves state-of-the-art performance, particularly excelling in scenarios with texture-less images. The code is available at https://github.com/ztsrxh/DVANet.

📄 PDF Abstract BibTeX arXiv:2402.08931

Code (1)

ztsrxh/DVANet 공식 구현 pytorch

Tasks

Depth EstimationStereo Matching

Similar Papers 제목 키워드 기반

DPSNet: End-to-end Deep Plane Sweep Stereo

2019-05-02 · ICLR 2019 5 · Sunghoon Im, Hae-Gon Jeon, Stephen Lin, In So Kweon

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges…

Deep LearningOptical Flow Estimation

Attention-Aware Multi-View Stereo

2020-06-01 · CVPR 2020 6 · Keyang Luo, Tao Guan, Lili Ju, Yuesong Wang 외

Multi-view stereo is a crucial task in computer vision, that requires accurate and robust photo-consistency among input images for depth estimation. Recent studies have shown that learning-based feature matching and conf…

Depth Estimation

Partially Supervised Multi-Task Network for Single-View Dietary Assessment

2020-07-15 · Ya Lu, Thomai Stathopoulou, Stavroula Mougiakakou

Food volume estimation is an essential step in the pipeline of dietary assessment and demands the precise depth estimation of the food surface and table plane. Existing methods based on computer vision require either mul…

Depth EstimationDepth Prediction

TSAR-MVS: Textureless-aware Segmentation and Correlative Refinement Guided Multi-View Stereo

2023-08-19 · Zhenlong Yuan, Jiakai Cao, Zhaoqi Wang, Zhaoxin Li

The reconstruction of textureless areas has long been a challenging problem in MVS due to lack of reliable pixel correspondences between images. In this paper, we propose the Textureless-aware Segmentation And Correlativ…

3D ReconstructionDepth CompletionEdge DetectionLine Detection+2

Chebyshev Attention Depth Permutation Texture Network with Latent Texture Attribute Loss

2025-01-01 · CVPR 2025 1 · Ravishankar Evani, Deepu Rajan, Shangbo Mao

Despite recent advances in deep texture recognition, existing methods still lack representational diversity and struggle to capture and preserve discriminative cues across stages of representation hierarchies. Moreov…

AttributeMaterial Recognition