paper-with-me

홈 › Papers

ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases

2017-11-30 · ECCV 2018 9 · Pierre Stock, Moustapha Cisse

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and their tendency to exhibit undesirable biases question the reliability of these methods. This work investigates these questions from the perspective of the end-user by using human subject studies and explanations. The contribution of this study is threefold. We first experimentally demonstrate that the accuracy and robustness of ConvNets measured on Imagenet are vastly underestimated. Next, we show that explanations can mitigate the impact of misclassified adversarial examples from the perspective of the end-user. We finally introduce a novel tool for uncovering the undesirable biases learned by a model. These contributions also show that explanations are a valuable tool both for improving our understanding of ConvNets' predictions and for designing more reliable models.

📄 PDF Abstract BibTeX arXiv:1711.11443

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage Classification

Similar Papers 제목 키워드 기반

ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy

2023-11-15 · Kirill Vishniakov, Zhiqiang Shen, Zhuang Liu

Modern computer vision offers a great variety of models to practitioners, and selecting a model from multiple options for specific applications can be challenging. Conventionally, competing model architectures and traini…

ClassificationDiversityRobust classificationSynthetic Image Attribution+1

UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio Video Point Cloud Time-Series and Image Recognition

2024-01-01 · CVPR 2024 1 · Xiaohan Ding, Yiyuan Zhang, Yixiao Ge, Sijie Zhao 외

Large-kernel convolutional neural networks (ConvNets) have recently received extensive research attention but two unresolved and critical issues demand further investigation. 1) The architectures of existing large-ke…

Time SeriesTime Series Forecasting

UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

2023-11-27 · Xiaohan Ding, Yiyuan Zhang, Yixiao Ge, Sijie Zhao 외

Large-kernel convolutional neural networks (ConvNets) have recently received extensive research attention, but two unresolved and critical issues demand further investigation. 1) The architectures of existing large-kerne…

Image ClassificationObject DetectionSemantic SegmentationTime Series+1

ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotations

2022-11-03 · Badr Youbi Idrissi, Diane Bouchacourt, Randall Balestriero, Ivan Evtimov 외

Deep learning vision systems are widely deployed across applications where reliability is critical. However, even today's best models can fail to recognize an object when its pose, lighting, or background varies. While e…

Data Augmentation

When does dough become a bagel? Analyzing the remaining mistakes on ImageNet

2022-05-09 · Vijay Vasudevan, Benjamin Caine, Raphael Gontijo-Lopes, Sara Fridovich-Keil 외

Image classification accuracy on the ImageNet dataset has been a barometer for progress in computer vision over the last decade. Several recent papers have questioned the degree to which the benchmark remains useful to t…

image-classificationImage Classification