paper-with-me

홈 › Papers

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

2021-10-25 · NeurIPS 2021 12 · Qiyu Kang, Yang song, Qinxu Ding, Wee Peng Tay

Deep neural networks (DNNs) are well-known to be vulnerable to adversarial attacks, where malicious human-imperceptible perturbations are included in the input to the deep network to fool it into making a wrong classification. Recent studies have demonstrated that neural Ordinary Differential Equations (ODEs) are intrinsically more robust against adversarial attacks compared to vanilla DNNs. In this work, we propose a stable neural ODE with Lyapunov-stable equilibrium points for defending against adversarial attacks (SODEF). By ensuring that the equilibrium points of the ODE solution used as part of SODEF is Lyapunov-stable, the ODE solution for an input with a small perturbation converges to the same solution as the unperturbed input. We provide theoretical results that give insights into the stability of SODEF as well as the choice of regularizers to ensure its stability. Our analysis suggests that our proposed regularizers force the extracted feature points to be within a neighborhood of the Lyapunov-stable equilibrium points of the ODE. SODEF is compatible with many defense methods and can be applied to any neural network's final regressor layer to enhance its stability against adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2110.12976

Code (2)

RobustBench/robustbench 공식 구현 pytorch
kangqiyu/sodef 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Lyapunov-Stable Deep Equilibrium Models

2023-04-25 · Haoyu Chu, Shikui Wei, Ting Liu, Yao Zhao 외

Deep equilibrium (DEQ) models have emerged as a promising class of implicit layer models, which abandon traditional depth by solving for the fixed points of a single nonlinear layer. Despite their success, the stability …

Adversarial DefenseAdversarial Robustness

Safe and Stable Filter Design Using a Relaxed Compatibitlity Control Barrier -- Lyapunov Condition

2024-06-29 · Han Wang, Kostas Margellos, Antonis Papachristodoulou

In this paper, we propose a quadratic programming-based filter for safe and stable controller design, via a Control Barrier Function (CBF) and a Control Lyapunov Function (CLF). Our method guarantees safety and local asy…

Lyapunov Probes for Hallucination Detection in Large Foundation Models

2026-03-06 · Bozhi Luan, Gen Li, Yalan Qin, Jifeng Guo 외 arxiv

We address hallucination detection in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) by framing the problem through the lens of dynamical systems stability theory. Rather than treating hallucin…

Adversarially Robust Out-of-Distribution Detection Using Lyapunov-Stabilized Embeddings

2024-10-14 · Hossein Mirzaei, Mackenzie W. Mathis

Despite significant advancements in out-of-distribution (OOD) detection, existing methods still struggle to maintain robustness against adversarial attacks, compromising their reliability in critical real-world applicati…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Further Geometric and Lyapunov Characterizations of Incrementally Stable Systems on Finsler Manifolds

2020-02-26 · Dongjun Wu, Guangren Duan

In this paper, we report several new geometric and Lyapunov characterizations of incrementally stable systems on Finsler and Riemannian manifolds. A new and intrinsic proof of an important theorem in contraction analysis…