paper-with-me

홈 › Papers

Bridging Optimal Transport and Jacobian Regularization by Optimal Trajectory for Enhanced Adversarial Defense

2023-03-21 · Binh M. Le, Shahroz Tariq, Simon S. Woo

Deep neural networks, particularly in vision tasks, are notably susceptible to adversarial perturbations. To overcome this challenge, developing a robust classifier is crucial. In light of the recent advancements in the robustness of classifiers, we delve deep into the intricacies of adversarial training and Jacobian regularization, two pivotal defenses. Our work is the first carefully analyzes and characterizes these two schools of approaches, both theoretically and empirically, to demonstrate how each approach impacts the robust learning of a classifier. Next, we propose our novel Optimal Transport with Jacobian regularization method, dubbed OTJR, bridging the input Jacobian regularization with the a output representation alignment by leveraging the optimal transport theory. In particular, we employ the Sliced Wasserstein distance that can efficiently push the adversarial samples' representations closer to those of clean samples, regardless of the number of classes within the dataset. The SW distance provides the adversarial samples' movement directions, which are much more informative and powerful for the Jacobian regularization. Our empirical evaluations set a new standard in the domain, with our method achieving commendable accuracies of 52.57% on CIFAR-10 and 28.3% on CIFAR-100 datasets under the AutoAttack. Further validating our model's practicality, we conducted real-world tests by subjecting internet-sourced images to online adversarial attacks. These demonstrations highlight our model's capability to counteract sophisticated adversarial perturbations, affirming its significance and applicability in real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2303.11793

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial AttackAdversarial DefenseAdversarial Robustness

Similar Papers 제목 키워드 기반

Bridging Maximum Likelihood and Optimal Transport for Efficient Inference and Model Selection in Stochastic Block Models

2026-05-27 · Simon Queric, Cédric Vincent-Cuaz, Charles Bouveyron, Marco Corneli arxiv

We study inference in stochastic block models (SBMs) through the lens of optimal transport (OT). We first establish that maximum likelihood variational inference (MLVI) can be interpreted as a semi-relaxed Gromov-Wassers…

An Homogeneous Unbalanced Regularized Optimal Transport model with applications to Optimal Transport with Boundary

2022-01-06 · Théo Lacombe

This work studies how the introduction of the entropic regularization term in unbalanced Optimal Transport (OT) models may alter their homogeneity with respect to the input measures. We observe that in common settings (i…

The statistical effect of entropic regularization in optimal transportation

2020-06-09 · Eustasio del Barrio, Jean-Michel Loubes

We propose to tackle the problem of understanding the effect of regularization in Sinkhorn algotihms. In the case of Gaussian distributions we provide a closed form for the regularized optimal transport which enables to …

Convergence rate of Tsallis entropic regularized optimal transport

2023-04-13 · Takeshi Suguro, Toshiaki Yachimura

In this paper, we study the Tsallis entropic regularized optimal transport in the continuous setting and establish fundamental results such as the $\Gamma$-convergence of the Tsallis regularized optimal transport to the …

Quantization

How to train your neural ODE: the world of Jacobian and kinetic regularization

2020-02-07 · ICML 2020 1 · Chris Finlay, Jörn-Henrik Jacobsen, Levon Nurbekyan, Adam M. Oberman

Training neural ODEs on large datasets has not been tractable due to the necessity of allowing the adaptive numerical ODE solver to refine its step size to very small values. In practice this leads to dynamics equivalent…

Density EstimationImage Generation