paper-with-me

Papers

Causality-based Neural Network Repair

2022-04-20 · Bing Sun, Jun Sun, Hong Long Pham, Jie Shi

Neural networks have had discernible achievements in a wide range of applications. The wide-spread adoption also raises the concern of their dependability and reliability. Similar to traditional decision-making programs, neural networks can have defects that need to be repaired. The defects may cause unsafe behaviors, raise security concerns or unjust societal impacts. In this work, we address the problem of repairing a neural network for desirable properties such as fairness and the absence of backdoor. The goal is to construct a neural network that satisfies the property by (minimally) adjusting the given neural network's parameters (i.e., weights). Specifically, we propose CARE (\textbf{CA}usality-based \textbf{RE}pair), a causality-based neural network repair technique that 1) performs causality-based fault localization to identify the `guilty' neurons and 2) optimizes the parameters of the identified neurons to reduce the misbehavior. We have empirically evaluated CARE on various tasks such as backdoor removal, neural network repair for fairness and safety properties. Our experiment results show that CARE is able to repair all neural networks efficiently and effectively. For fairness repair tasks, CARE successfully improves fairness by $61.91\%$ on average. For backdoor removal tasks, CARE reduces the attack success rate from over $98\%$ to less than $1\%$. For safety property repair tasks, CARE reduces the property violation rate to less than $1\%$. Results also show that thanks to the causality-based fault localization, CARE's repair focuses on the misbehavior and preserves the accuracy of the neural networks.

📄 PDF Abstract BibTeX arXiv:2204.09274

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingFairnessFault localization

Methods 이 논문이 사용한 방법론

Repair 설명 없음

Similar Papers 제목 키워드 기반

The Causality/Repair Connection in Databases: Causality-Programs

2017-04-17 · Leopoldo Bertossi

In this work, answer-set programs that specify repairs of databases are used as a basis for solving computational and reasoning problems about causes for query answers from databases.

Causal Repair of Learning-enabled Cyber-physical Systems

2023-04-06 · Pengyuan Lu, Ivan Ruchkin, Matthew Cleaveland, Oleg Sokolsky 외

Models of actual causality leverage domain knowledge to generate convincing diagnoses of events that caused an outcome. It is promising to apply these models to diagnose and repair run-time property violations in cyber-p…

counterfactualDiagnosticOpenAI Gym

From Causes for Database Queries to Repairs and Model-Based Diagnosis and Back

2015-07-01 · Leopoldo Bertossi, Babak Salimi

In this work we establish and investigate connections between causes for query answers in databases, database repairs wrt. denial constraints, and consistency-based diagnosis. The first two are relatively new research ar…

Query-Answer Causality in Databases: Abductive Diagnosis and View-Updates

2015-06-13 · Babak Salimi, Leopoldo Bertossi

Causality has been recently introduced in databases, to model, characterize and possibly compute causes for query results (answers). Connections between query causality and consistency-based diagnosis and database repair…

Specifying and Computing Causes for Query Answers in Databases via Database Repairs and Repair Programs

2017-12-04 · Leopoldo Bertossi

A correspondence between database tuples as causes for query answers in databases and tuple-based repairs of inconsistent databases with respect to denial constraints has already been established. In this work, answer-se…

Attribute