paper-with-me

Papers

Training on Foveated Images Improves Robustness to Adversarial Attacks

2023-08-01 · NeurIPS 2023 11

Deep neural networks (DNNs) have been shown to be vulnerable to adversarial attacks -- subtle, perceptually indistinguishable perturbations of inputs that change the response of the model. In the context of vision, we hypothesize that an important contributor to the robustness of human visual perception is constant exposure to low-fidelity visual stimuli in our peripheral vision. To investigate this hypothesis, we develop \RBlur, an image transform that simulates the loss in fidelity of peripheral vision by blurring the image and reducing its color saturation based on the distance from a given fixation point. We show that compared to DNNs trained on the original images, DNNs trained on images transformed by \RBlur are substantially more robust to adversarial attacks, as well as other, non-adversarial, corruptions, achieving up to 25\% higher accuracy on perturbed data.

📄 PDF Abstract BibTeX arXiv:2308.00854

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Evaluating the Adversarial Robustness of a Foveated Texture Transform Module in a CNN

2021-10-12 · NeurIPS Workshop SVRHM 2021 12 · Jonathan M Gant, Andrzej Banburski, Arturo Deza

Biologically inspired mechanisms such as foveation and multiple fixation points have previously been shown to help alleviate adversarial examples (Reddy et al., 2020). By mimicking the effects of visual crowding present …

Adversarial RobustnessFoveationScene ClassificationTexture Synthesis

Look, Focus, Act: Efficient and Robust Robot Learning via Human Gaze and Foveated Vision Transformers

2025-07-21 · Ian Chuang, Jinyu Zou, Andrew Lee, Dechen Gao 외 arxiv

Human vision is a highly active process driven by gaze, which directs attention to task-relevant regions through foveation, dramatically reducing visual processing. In contrast, robot learning systems typically rely on p…

Robot ManipulationImage Segmentation

FoveaTer: Foveated Transformer for Image Classification

2021-05-29 · Aditya Jonnalagadda, William Yang Wang, B. S. Manjunath, Miguel P. Eckstein

Many animals and humans process the visual field with a varying spatial resolution (foveated vision) and use peripheral processing to make eye movements and point the fovea to acquire high-resolution information about ob…

Classificationimage-classificationImage Classification

Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers

2026-07-10 · Ibrahim Batuhan Akkaya, Kishaan Jeeveswaran, Bahram Zonooz, Elahe Arani arxiv

The human visual system (HVS) employs foveated sampling and eye movements to achieve efficient perception, conserving both metabolic energy and computational resources. Drawing inspiration from this robustness and adapta…

Foveated Retinotopy Improves Classification and Localization in CNNs

2024-02-23 · Jean-Nicolas Jérémie, Emmanuel Daucé, Laurent U Perrinet

From a falcon detecting prey to humans recognizing faces, many species exhibit extraordinary abilities in rapid visual localization and classification. These are made possible by a specialized retinal region called the f…

ClassificationImage Categorizationimage-classificationImage Classification+2