paper-with-me

Papers

Shape and Texture: What Influences Reliable Optical Flow Estimation?

2025-01-01 · CVPR 2025 1 · Libo Long, Xiao Hu, Jochen Lang

Recent methods have made significant progress in optical flow estimation. However, the evaluation of these methods focuses mainly on improved accuracy in benchmarks and often overlooks the analysis of network robustness, which may be important in safety-critical scenarios such as autonomous driving. In this paper, we propose a novel method for robustness evaluation by modifying data from original benchmarks. Unlike previous benchmarks that focus on complex scenes, we propose to modify shape and texture of objects from the original images in order to analyze the sensitivity to these changes observed in the output. Our aim is to identify common failure cases of state-of-the-art (SOTA) methods to evaluate their robustness and understand their behaviors. We show that: Optical flow methods are more sensitive to shape changes than to texture changes; and optical flow methods tend to "remember" objects seen during training and may "ignore" the motion of unseen objects. Our experimental results and findings provide a more in-depth understanding of the behavior of recent optical flow methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingOptical Flow Estimation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

On the Influence of Shape, Texture and Color for Learning Semantic Segmentation

2024-10-18 · Annika Mütze, Natalie Grabowsky, Edgar Heinert, Matthias Rottmann 외

In recent years, a body of works has emerged, studying shape and texture biases of off-the-shelf pre-trained deep neural networks (DNN) for image classification. These works study how much a trained DNN relies on image c…

image-classificationImage ClassificationSemantic Segmentation

A 3D Morphable Model of Craniofacial Shape and Texture Variation

2017-10-01 · ICCV 2017 10 · Hang Dai, Nick Pears, William A. P. Smith, Christian Duncan

We present a fully automatic pipeline to train 3D Morphable Models (3DMMs), with contributions in pose normalisation, dense correspondence using both shape and texture information, and high quality, high resolution textu…

Optical Flow Estimation

A thin and soft optical tactile sensor for highly sensitive object perception

2026-02-03 · Yanchen Shen, Kohei Tsuji, Haruto Koizumi, Jiseon Hong 외 arxiv

Tactile sensing is crucial in robotics and wearable devices for safe perception and interaction with the environment. Optical tactile sensors have emerged as promising solutions, as they are immune to electromagnetic int…

The Origins and Prevalence of Texture Bias in Convolutional Neural Networks

2019-11-20 · NeurIPS 2020 12 · Katherine L. Hermann, Ting Chen, Simon Kornblith

Recent work has indicated that, unlike humans, ImageNet-trained CNNs tend to classify images by texture rather than by shape. How pervasive is this bias, and where does it come from? We find that, when trained on dataset…

Data AugmentationObject Recognition

3D shape reconstruction of semi-transparent worms

2023-04-28 · CVPR 2023 1 · Thomas P. Ilett, Omer Yuval, Thomas Ranner, Netta Cohen 외

3D shape reconstruction typically requires identifying object features or textures in multiple images of a subject. This approach is not viable when the subject is semi-transparent and moving in and out of focus. Here we…

3D Shape Reconstruction