paper-with-me

Papers

Visualizing Deep Neural Networks with Topographic Activation Maps

2022-04-07 · Valerie Krug, Raihan Kabir Ratul, Christopher Olson, Sebastian Stober

Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity of DNNs makes it difficult to understand how they solve their learned task. To improve the explainability of DNNs, we adapt methods from neuroscience that analyze complex and opaque systems. Here, we draw inspiration from how neuroscience uses topographic maps to visualize brain activity. To also visualize activations of neurons in DNNs as topographic maps, we research techniques to layout the neurons in a two-dimensional space such that neurons of similar activity are in the vicinity of each other. In this work, we introduce and compare methods to obtain a topographic layout of neurons in a DNN layer. Moreover, we demonstrate how to use topographic activation maps to identify errors or encoded biases and to visualize training processes. Our novel visualization technique improves the transparency of DNN-based decision-making systems and is interpretable without expert knowledge in Machine Learning.

📄 PDF Abstract BibTeX arXiv:2204.03528

Code (2)

andreaskrug/ann-topomaps 공식 구현 tf
valeriekrug/ann-topomaps 공식 구현 tf

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Visualizing Deep Neural Networks for Speech Recognition with Learned Topographic Filter Maps

2019-12-06 · Andreas Krug, Sebastian Stober

The uninformative ordering of artificial neurons in Deep Neural Networks complicates visualizing activations in deeper layers. This is one reason why the internal structure of such models is very unintuitive. In neurosci…

speech-recognitionSpeech Recognition

Visualizing Topographic Independent Component Analysis with Movies

2019-01-24 · Zhimin Chen, Darius Parvin, Maedbh King, Susan Hao

Independent component analysis (ICA) has often been used as a tool to model natural image statistics by separating multivariate signals in the image into components that are assumed to be independent. However, these esti…

Emergent organization of receptive fields in networks of excitatory and inhibitory neurons

2022-05-26 · Leon Lufkin, Ashish Puri, Ganlin Song, Xinyi Zhong 외

Local patterns of excitation and inhibition that can generate neural waves are studied as a computational mechanism underlying the organization of neuronal tunings. Sparse coding algorithms based on networks of excitator…

Topographic maps in the brain are fundamental to processing of causality

2018-11-12

The ubiquity of topographic maps in the brain has long been known, and molecular mechanisms for the formation of topographic organization of neural systems have been revealed. Less attention has been given to the questio…

Topographic Deep Artificial Neural Networks (TDANNs) predict face selectivity topography in primate inferior temporal (IT) cortex

2019-09-21

Deep convolutional neural networks are biologically driven models that resemble the hierarchical structure of primate visual cortex and are the current best predictors of the neural responses measured along the ventral s…