paper-with-me

Papers

SOAR: Second-Order Adversarial Regularization

2020-04-04 · Avery Ma, Fartash Faghri, Nicolas Papernot, Amir-Massoud Farahmand

Adversarial training is a common approach to improving the robustness of deep neural networks against adversarial examples. In this work, we propose a novel regularization approach as an alternative. To derive the regularizer, we formulate the adversarial robustness problem under the robust optimization framework and approximate the loss function using a second-order Taylor series expansion. Our proposed second-order adversarial regularizer (SOAR) is an upper bound based on the Taylor approximation of the inner-max in the robust optimization objective. We empirically show that the proposed method significantly improves the robustness of networks against the $\ell_\infty$ and $\ell_2$ bounded perturbations generated using cross-entropy-based PGD on CIFAR-10 and SVHN.

📄 PDF Abstract BibTeX arXiv:2004.01832

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Similar Papers 제목 키워드 기반

SOAR: Real-Time Joint Optimization of Order Allocation and Robot Scheduling in Robotic Mobile Fulfillment Systems

2026-05-05 · Yibang Tang, Yifan Yang, Jingyuan Wang, Junhua Chen 외 arxiv

Robotic Mobile Fulfillment Systems (RMFS) rely on mobile robots for automated inventory transportation, coordinating order allocation and robot scheduling to enhance warehousing efficiency. However, optimizing RMFS is ch…

Reinforcement Learning

SO-NeRF: Active View Planning for NeRF using Surrogate Objectives

2023-12-06 · Keifer Lee, Shubham Gupta, Sunglyoung Kim, Bhargav Makwana 외

Despite the great success of Neural Radiance Fields (NeRF), its data-gathering process remains vague with only a general rule of thumb of sampling as densely as possible. The lack of understanding of what actually consti…

DiversityNeRF

SOAR: Scene-debiasing Open-set Action Recognition

2023-09-03 · ICCV 2023 1 · Yuanhao Zhai, Ziyi Liu, Zhenyu Wu, Yi Wu 외

Deep learning models have a risk of utilizing spurious clues to make predictions, such as recognizing actions based on the background scene. This issue can severely degrade the open-set action recognition performance whe…

Action RecognitionDecoderOpen Set Action RecognitionScene Classification

Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models

2026-02-11 · Mingyu Cao, Alvaro H. C. Correia, Christos Louizos, Shiwei Liu 외 arxiv

Diffusion Language Models (DLMs) generate text by iteratively denoising a masked sequence, repeatedly deciding which positions to commit at each step. Standard decoding follows a greedy rule: unmask the most confident po…

Mathematical ReasoningCode Generation

SOAR: Self-supervision Optimized UAV Action Recognition with Efficient Object-Aware Pretraining

2024-09-26 · Ruiqi Xian, Xiyang Wu, Tianrui Guan, Xijun Wang 외

We introduce SOAR, a novel Self-supervised pretraining algorithm for aerial footage captured by Unmanned Aerial Vehicles (UAVs). We incorporate human object knowledge throughout the pretraining process to enhance UAV vid…

Action RecognitionObjectSelf-Supervised Learning