On the Impact of Interpretability Methods in Active Image Augmentation Method
Robustness is a significant constraint in machine learning models. The performance of the algorithms must not deteriorate when training and testing with slightly different data. Deep neural network models achieve awe-inspiring results in a wide range of applications of computer vision. Still, in the presence of noise or region occlusion, some models exhibit inaccurate performance even with data handled in training. Besides, some experiments suggest deep learning models sometimes use incorrect parts of the input information to perform inference. Activate Image Augmentation (ADA) is an augmentation method that uses interpretability methods to augment the training data and improve its robustness to face the described problems. Although ADA presented interesting results, its original version only used the Vanilla Backpropagation interpretability to train the U-Net model. In this work, we propose an extensive experimental analysis of the interpretability method's impact on ADA. We use five interpretability methods: Vanilla Backpropagation, Guided Backpropagation, GradCam, Guided GradCam, and InputXGradient. The results show that all methods achieve similar performance at the ending of training, but when combining ADA with GradCam, the U-Net model presented an impressive fast convergence.
Code (0)
등록된 구현이 없습니다.
Tasks
Image AugmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Analyzing Effects of Mixed Sample Data Augmentation on Model Interpretability
Data augmentation strategies are actively used when training deep neural networks (DNNs). Recent studies suggest that they are effective at various tasks. However, the effect of data augmentation on DNNs' interpretabilit…
Data AugmentationInterpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Data
Multi-centre colonoscopy images from various medical centres exhibit distinct complicating factors and overlays that impact the image content, contingent on the specific acquisition centre. Existing Deep Segmentation net…
Data AugmentationImage SegmentationSegmentationSemantic SegmentationLeveraging Image Augmentation for Object Manipulation: Towards Interpretable Controllability in Object-Centric Learning
The binding problem in artificial neural networks is actively explored with the goal of achieving human-level recognition skills through the comprehension of the world in terms of symbol-like entities. Especially in the …
Image AugmentationObjectEmbedding Shift Dissection on CLIP: Effects of Augmentations on VLM's Representation Learning
Understanding the representation shift on Vision Language Models like CLIP under different augmentations provides valuable insights on Mechanistic Interpretability. In this study, we show the shift on CLIP's embeddings o…
Representation LearningMosaic Augmentation for Text: Cropping and Collaging as Cross-Domain Techniques
We present new visually inspired cropping and collaging data augmentations for text. We test how these augmentations impact data-scarce scenarios over multiple NLP tasks: name entity recognition, extractive question answ…
Abstractive Text SummarizationExtractive Question-AnsweringQuestion Answering