Interpreting Hidden Semantics in the Intermediate Layers of 3D Point Cloud Classification Neural Network
Although 3D point cloud classification neural network models have been widely used, the in-depth interpretation of the activation of the neurons and layers is still a challenge. We propose a novel approach, named Relevance Flow, to interpret the hidden semantics of 3D point cloud classification neural networks. It delivers the class Relevance to the activated neurons in the intermediate layers in a back-propagation manner, and associates the activation of neurons with the input points to visualize the hidden semantics of each layer. Specially, we reveal that the 3D point cloud classification neural network has learned the plane-level and part-level hidden semantics in the intermediate layers, and utilize the normal and IoU to evaluate the consistency of both levels' hidden semantics. Besides, by using the hidden semantics, we generate the adversarial attack samples to attack 3D point cloud classifiers. Experiments show that our proposed method reveals the hidden semantics of the 3D point cloud classification neural network on ModelNet40 and ShapeNet, which can be used for the unsupervised point cloud part segmentation without labels and attacking the 3D point cloud classifiers.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Point Cloud ClassificationAdversarial AttackClassificationPoint Cloud ClassificationSimilar Papers 제목 키워드 기반
MTP-S2UT: Enhancing Speech-to-Speech Translation Quality with Multi-token Prediction
Current direct speech-to-speech translation methods predominantly employ speech tokens as intermediate representations. However, a single speech token is not dense in semantics, so we generally need multiple tokens to ex…
Speech-to-Speech TranslationBreaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection
Contextual word embeddings obtained from pre-trained language model (PLM) have proven effective for various natural language processing tasks at the word level. However, interpreting the hidden aspects within embeddings,…
Binary ClassificationLanguage ModelingLanguage ModellingRepresentation Learning+1Interpreting Embedding Spaces by Conceptualization
One of the main methods for computational interpretation of a text is mapping it into a vector in some embedding space. Such vectors can then be used for a variety of textual processing tasks. Recently, most embedding sp…
Towards Explainable LiDAR Point Cloud Semantic Segmentation via Gradient Based Target Localization
Semantic Segmentation (SS) of LiDAR point clouds is essential for many applications, such as urban planning and autonomous driving. While much progress has been made in interpreting SS predictions for images, interpretin…
Autonomous DrivingSemantic SegmentationNeural Collapse in the Intermediate Hidden Layers of Classification Neural Networks
Neural Collapse (NC) gives a precise description of the representations of classes in the final hidden layer of classification neural networks. This description provides insights into how these networks learn features an…