Characterizing the Decision Boundary of Deep Neural Networks
Deep neural networks and in particular, deep neural classifiers have become an integral part of many modern applications. Despite their practical success, we still have limited knowledge of how they work and the demand for such an understanding is evergrowing. In this regard, one crucial aspect of deep neural network classifiers that can help us deepen our knowledge about their decision-making behavior is to investigate their decision boundaries. Nevertheless, this is contingent upon having access to samples populating the areas near the decision boundary. To achieve this, we propose a novel approach we call Deep Decision boundary Instance Generation (DeepDIG). DeepDIG utilizes a method based on adversarial example generation as an effective way of generating samples near the decision boundary of any deep neural network model. Then, we introduce a set of important principled characteristics that take advantage of the generated instances near the decision boundary to provide multifaceted understandings of deep neural networks. We have performed extensive experiments on multiple representative datasets across various deep neural network models and characterized their decision boundaries. The code is publicly available at https://github.com/hamidkarimi/DeepDIG/.
Code (1)
Tasks
Decision MakingSimilar Papers 제목 키워드 기반
Remember the Decision, Not the Description: A Rate-Distortion Framework for Agent Memory
Long-horizon language agents must operate under limited runtime memory, yet existing memory mechanisms often organize experience around descriptive criteria such as relevance, salience, or summary quality. For an agent, …
Finding the Homology of Decision Boundaries with Active Learning
Accurately and efficiently characterizing the decision boundary of classifiers is important for problems related to model selection and meta-learning. Inspired by topological data analysis, the characterization of decisi…
Active LearningMeta-LearningModel SelectionTopological Data AnalysisLeader-follower synchronization and ISS analysis for a network of boundary-controlled wave PDEs
A network of agents, modeled by a class of wave PDEs, is under investigation. One agent in the network plays the role of a leader, and all the remaining "follower" agents are required to asymptotically track the state of…
Boundary controlled irreversible port-Hamiltonian systems
Boundary controlled irreversible port-Hamiltonian systems (BC-IPHS) on 1-dimensional spatial domains are defined by extending the formulation of reversible BC-PHS to irreversible thermodynamic systems controlled at the b…
Spectral Koopman Method for Identifying Stability Boundary
The paper is about characterizing the stability boundary of an autonomous dynamical system using the Koopman spectrum. For a dynamical system with an asymptotically stable equilibrium point, the domain of attraction cons…