paper-with-me

Papers

Attacking Optical Flow

2019-10-22 · ICCV 2019 10 · Anurag Ranjan, Joel Janai, Andreas Geiger, Michael J. Black

Deep neural nets achieve state-of-the-art performance on the problem of optical flow estimation. Since optical flow is used in several safety-critical applications like self-driving cars, it is important to gain insights into the robustness of those techniques. Recently, it has been shown that adversarial attacks easily fool deep neural networks to misclassify objects. The robustness of optical flow networks to adversarial attacks, however, has not been studied so far. In this paper, we extend adversarial patch attacks to optical flow networks and show that such attacks can compromise their performance. We show that corrupting a small patch of less than 1% of the image size can significantly affect optical flow estimates. Our attacks lead to noisy flow estimates that extend significantly beyond the region of the attack, in many cases even completely erasing the motion of objects in the scene. While networks using an encoder-decoder architecture are very sensitive to these attacks, we found that networks using a spatial pyramid architecture are less affected. We analyse the success and failure of attacking both architectures by visualizing their feature maps and comparing them to classical optical flow techniques which are robust to these attacks. We also demonstrate that such attacks are practical by placing a printed pattern into real scenes.

📄 PDF Abstract BibTeX arXiv:1910.10053

Code (1)

anuragranj/flowattack pytorch

Tasks

DecoderOptical Flow EstimationSelf-Driving Cars

Similar Papers 제목 키워드 기반

A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flow

2022-03-24 · Jenny Schmalfuss, Philipp Scholze, Andrés Bruhn

Recent optical flow methods are almost exclusively judged in terms of accuracy, while their robustness is often neglected. Although adversarial attacks offer a useful tool to perform such an analysis, current attacks on …

Adversarial AttackAdversarial RobustnessOptical Flow Estimation

Attacking Motion Estimation with Adversarial Snow

2022-10-20 · Jenny Schmalfuss, Lukas Mehl, Andrés Bruhn

Current adversarial attacks for motion estimation (optical flow) optimize small per-pixel perturbations, which are unlikely to appear in the real world. In contrast, we exploit a real-world weather phenomenon for a novel…

Motion EstimationOptical Flow Estimation

Learning Optical Expansion From Scale Matching

2023-01-01 · CVPR 2023 1 · Han Ling, Yinghui Sun, Quansen Sun, Zhenwen Ren

This paper address the problem of optical expansion (OE). OE describes the object scale change between two frames, widely used in monocular 3D vision tasks. Previous methods estimate optical expansion mainly from opt…

Optical Flow Estimation

Self-Supervised Approach for Facial Movement Based Optical Flow

2021-05-04 · Muhannad Alkaddour, Usman Tariq, Abhinav Dhall

Computing optical flow is a fundamental problem in computer vision. However, deep learning-based optical flow techniques do not perform well for non-rigid movements such as those found in faces, primarily due to lack of …

Micro Expression RecognitionMicro-Expression RecognitionOptical Flow Estimation

FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimation

2023-12-28 · Miaojie Feng, Longliang Liu, Hao Jia, Gangwei Xu 외

Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual …

Dataset GenerationOptical Flow Estimation