Conceptual Content in Deep Convolutional Neural Networks: An analysis into multi-faceted properties of neurons
In this paper, convolutional layers of pre-trained VGG16 model are analyzed. The analysis is based on the responses of neurons to the images of classes in ImageNet database. First, a visualization method is proposed in order to illustrate the learned content of each neuron. Next, single and multi-faceted neurons are investigated based on the diversity of neurons responses to different category of objects. Finally, neuronal similarities at each layer are computed and compared. The results demonstrate that the neurons in lower layers exhibit a multi-faceted behavior, whereas the majority of neurons in higher layers com-prise single-faceted property and tend to respond to a smaller number of concepts.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversitySimilar Papers 제목 키워드 기반
Graph Neural Networks for Knowledge Enhanced Visual Representation of Paintings
We propose ArtSAGENet, a novel multimodal architecture that integrates Graph Neural Networks (GNNs) and Convolutional Neural Networks (CNNs), to jointly learn visual and semantic-based artistic representations. First, we…
Art AnalysisMulti-Task LearningPeriod EstimationTAGConceptual Analysis of Hypertext
In this chapter tools and techniques from the mathematical theory of formal concept analysis are applied to hypertext systems in general, and the World Wide Web in particular. Various processes for the conceptual structu…
Towards Creating Interoperable Resources for Conceptual Annotation of Multilingual Domain Corpora
In this paper we focus on creation of interoperable annotation resources that make up a significant proportion of an on-going project on the development of conceptually annotated multilingual corpora for the domain of te…
Machine TranslationTranslationMeanings are like Onions: a Layered Approach to Metaphor Processing
Metaphorical meaning is not a flat mapping between concepts, but a complex cognitive phenomenon that integrates multiple levels of interpretation. In this paper, we propose a stratified model of metaphor processing that …
Conceptual Compression via Deep Structure and Texture Synthesis
Existing compression methods typically focus on the removal of signal-level redundancies, while the potential and versatility of decomposing visual data into compact conceptual components still lack further study. To thi…
Texture Synthesis