paper-with-me

홈 › Papers

On the Impact of Interpretability Methods in Active Image Augmentation Method

2021-02-24 · Flavio Santos, Cleber Zanchettin, Leonardo Matos, Paulo Novais

Robustness is a significant constraint in machine learning models. The performance of the algorithms must not deteriorate when training and testing with slightly different data. Deep neural network models achieve awe-inspiring results in a wide range of applications of computer vision. Still, in the presence of noise or region occlusion, some models exhibit inaccurate performance even with data handled in training. Besides, some experiments suggest deep learning models sometimes use incorrect parts of the input information to perform inference. Activate Image Augmentation (ADA) is an augmentation method that uses interpretability methods to augment the training data and improve its robustness to face the described problems. Although ADA presented interesting results, its original version only used the Vanilla Backpropagation interpretability to train the U-Net model. In this work, we propose an extensive experimental analysis of the interpretability method's impact on ADA. We use five interpretability methods: Vanilla Backpropagation, Guided Backpropagation, GradCam, Guided GradCam, and InputXGradient. The results show that all methods achieve similar performance at the ending of training, but when combining ADA with GradCam, the U-Net model presented an impressive fast convergence.

📄 PDF Abstract BibTeX arXiv:2102.12354

Code (0)

등록된 구현이 없습니다.

Tasks

Image Augmentation

Methods 이 논문이 사용한 방법론

ADA 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Analyzing Effects of Mixed Sample Data Augmentation on Model Interpretability

2023-03-26 · Soyoun Won, Sung-Ho Bae, Seong Tae Kim

Data augmentation strategies are actively used when training deep neural networks (DNNs). Recent studies suggest that they are effective at various tasks. However, the effect of data augmentation on DNNs' interpretabilit…

Data Augmentation

Interpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Data

2023-08-30 · Valentina Corbetta, Regina Beets-Tan, Wilson Silva

Multi-centre colonoscopy images from various medical centres exhibit distinct complicating factors and overlays that impact the image content, contingent on the specific acquisition centre. Existing Deep Segmentation net…

Data AugmentationImage SegmentationSegmentationSemantic Segmentation

Leveraging Image Augmentation for Object Manipulation: Towards Interpretable Controllability in Object-Centric Learning

2023-10-13 · Jinwoo Kim, Janghyuk Choi, Jaehyun Kang, Changyeon Lee 외

The binding problem in artificial neural networks is actively explored with the goal of achieving human-level recognition skills through the comprehension of the world in terms of symbol-like entities. Especially in the …

Image AugmentationObject

Embedding Shift Dissection on CLIP: Effects of Augmentations on VLM's Representation Learning

2025-03-30 · Ashim Dahal, Saydul Akbar Murad, Nick Rahimi

Understanding the representation shift on Vision Language Models like CLIP under different augmentations provides valuable insights on Mechanistic Interpretability. In this study, we show the shift on CLIP's embeddings o…

Representation Learning

Mosaic Augmentation for Text: Cropping and Collaging as Cross-Domain Techniques

2022-01-16 · ACL ARR January 2022 1 · Anonymous

We present new visually inspired cropping and collaging data augmentations for text. We test how these augmentations impact data-scarce scenarios over multiple NLP tasks: name entity recognition, extractive question answ…

Abstractive Text SummarizationExtractive Question-AnsweringQuestion Answering