paper-with-me

홈 › Papers

Extreme Image Transformations Facilitate Robust Latent Object Representations

2023-09-19 · Girik Malik, Dakarai Crowder, Ennio Mingolla

Adversarial attacks can affect the object recognition capabilities of machines in wild. These can often result from spurious correlations between input and class labels, and are prone to memorization in large networks. While networks are expected to do automated feature selection, it is not effective at the scale of the object. Humans, however, are able to select the minimum set of features required to form a robust representation of an object. In this work, we show that finetuning any pretrained off-the-shelf network with Extreme Image Transformations (EIT) not only helps in learning a robust latent representation, it also improves the performance of these networks against common adversarial attacks of various intensities. Our EIT trained networks show strong activations in the object regions even when tested with more intense noise, showing promising generalizations across different kinds of adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2310.07725

Code (0)

등록된 구현이 없습니다.

Tasks

feature selectionMemorizationObjectObject Recognition

Similar Papers 제목 키워드 기반

Tensor Component Analysis for Interpreting the Latent Space of GANs

2021-11-23 · James Oldfield, Markos Georgopoulos, Yannis Panagakis, Mihalis A. Nicolaou 외

This paper addresses the problem of finding interpretable directions in the latent space of pre-trained Generative Adversarial Networks (GANs) to facilitate controllable image synthesis. Such interpretable directions cor…

Image Generation

Robustness of Humans and Machines on Object Recognition with Extreme Image Transformations

2022-05-09 · Dakarai Crowder, Girik Malik

Recent neural network architectures have claimed to explain data from the human visual cortex. Their demonstrated performance is however still limited by the dependence on exploiting low-level features for solving visual…

Object Recognition

Disentangled Lifespan Face Synthesis

2021-08-05 · ICCV 2021 10 · Sen He, Wentong Liao, Michael Ying Yang, Yi-Zhe Song 외

A lifespan face synthesis (LFS) model aims to generate a set of photo-realistic face images of a person's whole life, given only one snapshot as reference. The generated face image given a target age code is expected to …

Face Generation

Disentangling Patterns and Transformations from One Sequence of Images with Shape-invariant Lie Group Transformer

2022-03-21 · T. Takada, W. Shimaya, Y. Ohmura, Y. Kuniyoshi

An effective way to model the complex real world is to view the world as a composition of basic components of objects and transformations. Although humans through development understand the compositionality of the real w…

Representation Learning

No Representation without Transformation

2019-12-09 · Giorgio Giannone, Saeed Saremi, Jonathan Masci, Christian Osendorfer

We extend the framework of variational autoencoders to represent transformations explicitly in the latent space. In the family of hierarchical graphical models that emerges, the latent space is populated by higher order …