Understanding Regularization to Visualize Convolutional Neural Networks
Variational methods for revealing visual concepts learned by convolutional neural networks have gained significant attention during the last years. Being based on noisy gradients obtained via back-propagation such methods require the application of regularization strategies. We present a mathematical framework unifying previously employed regularization methods. Within this framework, we propose a novel technique based on Sobolev gradients which can be implemented via convolutions and does not require specialized numerical treatment, such as total variation regularization. The experiments performed on feature inversion and activation maximization demonstrate the benefit of a unified approach to regularization, such as sharper reconstructions via the proposed Sobolev filters and a better control over reconstructed scales.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Understanding Neural Networks Through Deep Visualization
Recent years have produced great advances in training large, deep neural networks (DNNs), including notable successes in training convolutional neural networks (convnets) to recognize natural images. However, our underst…
Interpretable Machine LearningFeature Visualization in 3D Convolutional Neural Networks
Understanding the computations of convolutional neural networks requires effective visualization of their kernels. While maximal activation methods have proven successful in highlighting the preferred features of 2D conv…
MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing
Existing popular methods for semi-supervised learning with Graph Neural Networks (such as the Graph Convolutional Network) provably cannot learn a general class of neighborhood mixing relationships. To address this weakn…
Node ClassificationNode Classification on Non-Homophilic (Heterophilic) GraphsUnderstanding Neural Network Systems for Image Analysis using Vector Spaces and Inverse Maps
There is strong interest in developing mathematical methods that can be used to understand complex neural networks used in image analysis. In this paper, we introduce techniques from Linear Algebra to model neural networ…
Interpreting intermediate convolutional layers in unsupervised acoustic word classification
Understanding how deep convolutional neural networks classify data has been subject to extensive research. This paper proposes a technique to visualize and interpret intermediate layers of unsupervised deep convolutional…
ClassificationregressionTime SeriesTime Series Analysis