paper-with-me

홈 › Papers

AdjointBackMap: Reconstructing Effective Decision Hypersurfaces from CNN Layers Using Adjoint Operators

2020-12-16 · Qing Wan, Yoonsuck Choe

There are several effective methods in explaining the inner workings of convolutional neural networks (CNNs). However, in general, finding the inverse of the function performed by CNNs as a whole is an ill-posed problem. In this paper, we propose a method based on adjoint operators to reconstruct, given an arbitrary unit in the CNN (except for the first convolutional layer), its effective hypersurface in the input space that replicates that unit's decision surface conditioned on a particular input image. Our results show that the hypersurface reconstructed this way, when multiplied by the original input image, would give nearly the exact output value of that unit. We find that the CNN unit's decision surface is largely conditioned on the input, and this may explain why adversarial inputs can effectively deceive CNNs.

📄 PDF Abstract BibTeX arXiv:2012.09020

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AdjointBackMapV2: Precise Reconstruction of Arbitrary CNN Unit's Activation via Adjoint Operators

2021-10-04 · Qing Wan, Siu Wun Cheung, Yoonsuck Choe

Adjoint operators have been found to be effective in the exploration of CNN's inner workings [1]. However, the previous no-bias assumption restricted its generalization. We overcome the restriction via embedding input im…

Machine Learning Calabi-Yau Hypersurfaces

2021-12-12 · David S. Berman, Yang-Hui He, Edward Hirst

We revisit the classic database of weighted-P4s which admit Calabi-Yau 3-fold hypersurfaces equipped with a diverse set of tools from the machine-learning toolbox. Unsupervised techniques identify an unanticipated almost…

BIG-bench Machine LearningClustering

Adapter Pruning using Tropical Characterization

2023-10-30 · Rishabh Bhardwaj, Tushar Vaidya, Soujanya Poria

Adapters are widely popular parameter-efficient transfer learning approaches in natural language processing that insert trainable modules in between layers of a pre-trained language model. Apart from several heuristics, …

Language ModelingLanguage ModellingTransfer Learning

The Geometry of Robust Value Functions

2022-01-30 · Kaixin Wang, Navdeep Kumar, Kuangqi Zhou, Bryan Hooi 외

The space of value functions is a fundamental concept in reinforcement learning. Characterizing its geometric properties may provide insights for optimization and representation. Existing works mainly focus on the value …

Polyhedral Complex Derivation from Piecewise Trilinear Networks

2024-02-16 · Jin-Hwa Kim

Recent advancements in visualizing deep neural networks provide insights into their structures and mesh extraction from Continuous Piecewise Affine (CPWA) functions. Meanwhile, developments in neural surface representati…

Representation Learning