paper-with-me

홈 › Papers

Minimal Multi-Layer Modifications of Deep Neural Networks

2021-10-18 · Idan Refaeli, Guy Katz

Deep neural networks (DNNs) have become increasingly popular in recent years. However, despite their many successes, DNNs may also err and produce incorrect and potentially fatal outputs in safety-critical settings, such as autonomous driving, medical diagnosis, and airborne collision avoidance systems. Much work has been put into detecting such erroneous behavior in DNNs, e.g., via testing or verification, but removing these errors after their detection has received lesser attention. We present here a new tool, called 3M-DNN, for repairing a given DNN, which is known to err on some set of inputs. The novel repair procedure implemented in 3M-DNN computes a modification to the network's weights that corrects its behavior, and attempts to minimize this change via a sequence of calls to a backend, black-box DNN verification engine. To the best of our knowledge, our method is the first one that allows repairing the network by simultaneously modifying multiple layers. This is achieved by splitting the network into sub-networks, and applying a single-layer repairing technique to each component. We evaluated 3M-DNN tool on an extensive set of benchmarks, obtaining promising results.

📄 PDF Abstract BibTeX arXiv:2110.09929

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingCollision AvoidanceMedical Diagnosis

Methods 이 논문이 사용한 방법론

Repair 설명 없음

Similar Papers 제목 키워드 기반

Improving Editability in Image Generation with Layer-wise Memory

2025-05-02 · CVPR 2025 1 · Daneul Kim, Jaeah Lee, Jaesik Park

Most real-world image editing tasks require multiple sequential edits to achieve desired results. Current editing approaches, primarily designed for single-object modifications, struggle with sequential editing: especial…

DisentanglementImage Generation

Sequential training algorithm for neural networks

2019-05-17 · Jongrae Kim

A sequential training method for large-scale feedforward neural networks is presented. Each layer of the neural network is decoupled and trained separately. After the training is completed for each layer, they are combin…

Why is Pruning at Initialization Immune to Reinitializing and Shuffling?

2021-07-05 · Sahib Singh, Rosanne Liu

Recent studies assessing the efficacy of pruning neural networks methods uncovered a surprising finding: when conducting ablation studies on existing pruning-at-initialization methods, namely SNIP, GraSP, SynFlow, and ma…

Undivided Attention: Are Intermediate Layers Necessary for BERT?

2020-12-22 · Sharath Nittur Sridhar, Anthony Sarah

In recent times, BERT-based models have been extremely successful in solving a variety of natural language processing (NLP) tasks such as reading comprehension, natural language inference, sentiment analysis, etc. All BE…

Natural Language InferenceReading ComprehensionSentiment Analysis

Function Space Diversity for Uncertainty Prediction via Repulsive Last-Layer Ensembles

2024-12-20 · Sophie Steger, Christian Knoll, Bernhard Klein, Holger Fröning 외

Bayesian inference in function space has gained attention due to its robustness against overparameterization in neural networks. However, approximating the infinite-dimensional function space introduces several challenge…

Active LearningBayesian InferenceData AugmentationDiversity