paper-with-me

홈 › Papers

KoALA: KL-L0 Adversarial Detector via Label Agreement

2025-10-14 · Siqi Li, Yasser Shoukry arxiv

Deep neural networks are highly susceptible to adversarial attacks, which pose significant risks to security- and safety-critical applications. We present KoALA (KL-L0 Adversarial detection via Label Agreement), a novel, semantics-free adversarial detector that requires no architectural changes or adversarial retraining. KoALA operates on a simple principle: it detects an adversarial attack when class predictions from two complementary similarity metrics disagree. These metrics - KL divergence and an L0-based similarity - are specifically chosen to detect different types of perturbations. The KL divergence metric is sensitive to dense, low-amplitude shifts, while the L0-based similarity is designed for sparse, high-impact changes. We provide a formal proof of correctness for our approach. The only training required is a simple fine-tuning step on a pre-trained image encoder using clean images to ensure the embeddings align well with both metrics. This makes KoALA a lightweight, plug-and-play solution for existing models and various data modalities. Our extensive experiments on ResNet/CIFAR-10 and CLIP/Tiny-ImageNet confirm our theoretical claims. When the theorem's conditions are met, KoALA consistently and effectively detects adversarial examples. On the full test sets, KoALA achieves a precision of 0.96 and a recall of 0.97 on ResNet/CIFAR-10, and a precision of 0.71 and a recall of 0.94 on CLIP/Tiny-ImageNet.

📄 PDF Abstract BibTeX arXiv:2510.12752

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Attack

Similar Papers 제목 키워드 기반

KOALA: Enhancing Speculative Decoding for LLM via Multi-Layer Draft Heads with Adversarial Learning

2024-08-15 · Kaiqi Zhang, Jing Zhao, Rui Chen

Large Language Models (LLMs) exhibit high inference latency due to their autoregressive decoding nature. While the draft head in speculative decoding mitigates this issue, its full potential remains unexplored. In this p…

Koala: An Index for Quantifying Overlaps with Pre-training Corpora

2023-03-26 · Thuy-Trang Vu, Xuanli He, Gholamreza Haffari, Ehsan Shareghi

In very recent years more attention has been placed on probing the role of pre-training data in Large Language Models (LLMs) downstream behaviour. Despite the importance, there is no public tool that supports such analys…

Memorization

CrossRectify: Leveraging Disagreement for Semi-supervised Object Detection

2022-01-26 · Chengcheng Ma, Xingjia Pan, Qixiang Ye, Fan Tang 외

Semi-supervised object detection has recently achieved substantial progress. As a mainstream solution, the self-labeling-based methods train the detector on both labeled data and unlabeled data with pseudo labels predict…

Objectobject-detectionObject DetectionPseudo Label+1

KOALAnet: Blind Super-Resolution using Kernel-Oriented Adaptive Local Adjustment

2020-12-15 · CVPR 2021 1 · Soo Ye Kim, Hyeonjun Sim, Munchurl Kim

Blind super-resolution (SR) methods aim to generate a high quality high resolution image from a low resolution image containing unknown degradations. However, natural images contain various types and amounts of blur: som…

Blind Super-ResolutionSuper-Resolution

KOALA++: Efficient Kalman-Based Optimization of Neural Networks with Gradient-Covariance Products

2025-06-04 · Zixuan Xia, Aram Davtyan, Paolo Favaro

We propose KOALA++, a scalable Kalman-based optimization algorithm that explicitly models structured gradient uncertainty in neural network training. Unlike second-order methods, which rely on expensive second order grad…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+1