paper-with-me

Papers

DispBench: Benchmarking Disparity Estimation to Synthetic Corruptions

2025-05-08 · Shashank Agnihotri, Amaan Ansari, Annika Dackermann, Fabian Rösch, Margret Keuper

Deep learning (DL) has surpassed human performance on standard benchmarks, driving its widespread adoption in computer vision tasks. One such task is disparity estimation, estimating the disparity between matching pixels in stereo image pairs, which is crucial for safety-critical applications like medical surgeries and autonomous navigation. However, DL-based disparity estimation methods are highly susceptible to distribution shifts and adversarial attacks, raising concerns about their reliability and generalization. Despite these concerns, a standardized benchmark for evaluating the robustness of disparity estimation methods remains absent, hindering progress in the field. To address this gap, we introduce DispBench, a comprehensive benchmarking tool for systematically assessing the reliability of disparity estimation methods. DispBench evaluates robustness against synthetic image corruptions such as adversarial attacks and out-of-distribution shifts caused by 2D Common Corruptions across multiple datasets and diverse corruption scenarios. We conduct the most extensive performance and robustness analysis of disparity estimation methods to date, uncovering key correlations between accuracy, reliability, and generalization. Open-source code for DispBench: https://github.com/shashankskagnihotri/benchmarking_robustness/tree/disparity_estimation/final/disparity_estimation

📄 PDF Abstract BibTeX arXiv:2505.05091

Code (1)

shashankskagnihotri/benchmarking_robustness 공식 구현 pytorch

Tasks

Autonomous NavigationBenchmarkingDisparity Estimation

Similar Papers 제목 키워드 기반

Are Synthetic Corruptions A Reliable Proxy For Real-World Corruptions?

2025-05-07 · Shashank Agnihotri, David Schader, Nico Sharei, Mehmet Ege Kaçar 외

Deep learning (DL) models are widely used in real-world applications but remain vulnerable to distribution shifts, especially due to weather and lighting changes. Collecting diverse real-world data for testing the robust…

BenchmarkingSemantic Segmentation

Benchmarking the Robustness of Optical Flow Estimation to Corruptions

2024-11-22 · Zhonghua Yi, Hao Shi, Qi Jiang, Yao Gao 외

Optical flow estimation is extensively used in autonomous driving and video editing. While existing models demonstrate state-of-the-art performance across various benchmarks, the robustness of these methods has been infr…

Autonomous DrivingBenchmarkingOptical Flow EstimationVideo Editing

Using Synthetic Corruptions to Measure Robustness to Natural Distribution Shifts

2021-07-26 · Alfred Laugros, Alice Caplier, Matthieu Ospici

Synthetic corruptions gathered into a benchmark are frequently used to measure neural network robustness to distribution shifts. However, robustness to synthetic corruption benchmarks is not always predictive of robustne…

A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation

2015-12-07 · CVPR 2016 6 · Nikolaus Mayer, Eddy Ilg, Philip Häusser, Philipp Fischer 외

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synt…

Disparity EstimationOptical Flow EstimationScene Flow Estimation

Benchmarking Robustness to Text-Guided Corruptions

2023-04-06 · Mohammadreza Mofayezi, Yasamin Medghalchi

This study investigates the robustness of image classifiers to text-guided corruptions. We utilize diffusion models to edit images to different domains. Unlike other works that use synthetic or hand-picked data for bench…

BenchmarkingData Augmentation