paper-with-me

Papers

Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers

2021-12-09 · Zunlei Feng, Jiacong Hu, Sai Wu, Xiaotian Yu, Jie Song, Mingli Song

Recently, Convolutional Neural Network (CNN) has achieved excellent performance in the classification task. It is widely known that CNN is deemed as a 'black-box', which is hard for understanding the prediction mechanism and debugging the wrong prediction. Some model debugging and explanation works are developed for solving the above drawbacks. However, those methods focus on explanation and diagnosing possible causes for model prediction, based on which the researchers handle the following optimization of models manually. In this paper, we propose the first completely automatic model diagnosing and treating tool, termed as Model Doctor. Based on two discoveries that 1) each category is only correlated with sparse and specific convolution kernels, and 2) adversarial samples are isolated while normal samples are successive in the feature space, a simple aggregate gradient constraint is devised for effectively diagnosing and optimizing CNN classifiers. The aggregate gradient strategy is a versatile module for mainstream CNN classifiers. Extensive experiments demonstrate that the proposed Model Doctor applies to all existing CNN classifiers, and improves the accuracy of $16$ mainstream CNN classifiers by 1%-5%.

📄 PDF Abstract BibTeX arXiv:2112.04934

Code (1)

JacyHu/model_doctor 공식 구현 pytorch

Tasks

Prediction

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Using LLM for Real-Time Transcription and Summarization of Doctor-Patient Interactions into ePuskesmas in Indonesia

2024-09-25 · Azmul Asmar Irfan, Nur Ahmad Khatim, Mansur M. Arief

One of the key issues contributing to inefficiency in Puskesmas is the time-consuming nature of doctor-patient interactions. Doctors need to conduct thorough consultations, which include diagnosing the patient's conditio…

Large Language Model

Model Doctor for Diagnosing and Treating Segmentation Error

2023-02-17 · Zhijie Jia, Lin Chen, Kaiwen Hu, Lechao Cheng 외

Despite the remarkable progress in semantic segmentation tasks with the advancement of deep neural networks, existing U-shaped hierarchical typical segmentation networks still suffer from local misclassification of categ…

modelSegmentationSemantic Segmentation

DOCTOR: A Simple Method for Detecting Misclassification Errors

2021-06-04 · NeurIPS 2021 12 · Federica Granese, Marco Romanelli, Daniele Gorla, Catuscia Palamidessi 외

Deep neural networks (DNNs) have shown to perform very well on large scale object recognition problems and lead to widespread use for real-world applications, including situations where DNN are implemented as "black boxe…

Object RecognitionSentiment Analysis

DiffDoctor: Diagnosing Image Diffusion Models Before Treating

2025-01-21 · Yiyang Wang, Xi Chen, Xiaogang Xu, Sihui Ji 외

In spite of the recent progress, image diffusion models still produce artifacts. A common solution is to refine an established model with a quality assessment system, which generally rates an image in its entirety. In th…

A Role-specific Guided Large Language Model for Ophthalmic Consultation Based on Stylistic Differentiation

2024-07-26 · Laiyi Fu, Binbin Fan, Hongkai Du, Yanxiang Feng 외

Ophthalmology consultations are crucial for diagnosing, treating, and preventing eye diseases. However, the growing demand for consultations exceeds the availability of ophthalmologists. By leveraging large pre-trained l…

Language ModelingLanguage ModellingLarge Language ModelQuestion Answering