Explaining Model Overfitting in CNNs via GMM Clustering
Convolutional Neural Networks (CNNs) have demonstrated remarkable prowess in the field of computer vision. However, their opaque decision-making processes pose significant challenges for practical applications. In this study, we provide quantitative metrics for assessing CNN filters by clustering the feature maps corresponding to individual filters in the model via Gaussian Mixture Model (GMM). By analyzing the clustering results, we screen out some anomaly filters associated with outlier samples. We further analyze the relationship between the anomaly filters and model overfitting, proposing three hypotheses. This method is universally applicable across diverse CNN architectures without modifications, as evidenced by its successful application to models like AlexNet and LeNet-5. We present three meticulously designed experiments demonstrating our hypotheses from the perspectives of model behavior, dataset characteristics, and filter impacts. Through this work, we offer a novel perspective for evaluating the CNN performance and gain new insights into the operational behavior of model overfitting.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDecision MakingmodelSimilar Papers 제목 키워드 기반
Beyond explaining: XAI-based Adaptive Learning with SHAP Clustering for Energy Consumption Prediction
This paper presents an approach integrating explainable artificial intelligence (XAI) techniques with adaptive learning to enhance energy consumption prediction models, with a focus on handling data distribution shifts. …
ClusteringExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)A Post-Training Approach for Mitigating Overfitting in Quantum Convolutional Neural Networks
Quantum convolutional neural network (QCNN), an early application for quantum computers in the NISQ era, has been consistently proven successful as a machine learning (ML) algorithm for several tasks with significant acc…
Case Study: Explaining Diabetic Retinopathy Detection Deep CNNs via Integrated Gradients
In this report, we applied integrated gradients to explaining a neural network for diabetic retinopathy detection. The integrated gradient is an attribution method which measures the contributions of input to the quantit…
Diabetic Retinopathy DetectionLearning Semantically Coherent and Reusable Kernels in Convolution Neural Nets for Sentence Classification
The state-of-the-art CNN models give good performance on sentence classification tasks. The purpose of this work is to empirically study desirable properties such as semantic coherence, attention mechanism and reusabilit…
ClusteringGeneral ClassificationSentenceSentence ClassificationUnderstanding Convolutional Neural Networks for Text Classification
We present an analysis into the inner workings of Convolutional Neural Networks (CNNs) for processing text. CNNs used for computer vision can be interpreted by projecting filters into image space, but for discrete sequen…
ClassificationGeneral Classificationtext-classificationText Classification