paper-with-me

홈 › Papers

Human Aligned Compression for Robust Models

2025-04-16 · Samuel Räber, Andreas Plesner, Till Aczel, Roger Wattenhofer

Adversarial attacks on image models threaten system robustness by introducing imperceptible perturbations that cause incorrect predictions. We investigate human-aligned learned lossy compression as a defense mechanism, comparing two learned models (HiFiC and ELIC) against traditional JPEG across various quality levels. Our experiments on ImageNet subsets demonstrate that learned compression methods outperform JPEG, particularly for Vision Transformer architectures, by preserving semantically meaningful content while removing adversarial noise. Even in white-box settings where attackers can access the defense, these methods maintain substantial effectiveness. We also show that sequential compression--applying rounds of compression/decompression--significantly enhances defense efficacy while maintaining classification performance. Our findings reveal that human-aligned compression provides an effective, computationally efficient defense that protects the image features most relevant to human and machine understanding. It offers a practical approach to improving model robustness against adversarial threats.

📄 PDF Abstract BibTeX arXiv:2504.12255

Code (1)

aplesner/Human-aligned-compression-for-robust-models 공식 구현

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

VLIC: Vision-Language Models As Perceptual Judges for Human-Aligned Image Compression

2025-12-17 · Kyle Sargent, Ruiqi Gao, Philipp Henzler, Charles Herrmann 외 arxiv

Evaluations of image compression performance which include human preferences have generally found that naive distortion functions such as MSE are insufficiently aligned to human perception. In order to align compression …

Image CompressionVisual Reasoning

Evolution and compression in LLMs: On the emergence of human-aligned categorization

2025-09-09 · Nathaniel Imel, Noga Zaslavsky arxiv

Converging evidence suggests that human systems of semantic categories achieve near-optimal compression via the Information Bottleneck (IB) complexity-accuracy tradeoff. Large language models (LLMs) are not trained for t…

Geometric Prior Based Deep Human Point Cloud Geometry Compression

2023-05-02 · Xinju Wu, Pingping Zhang, Meng Wang, Peilin Chen 외

The emergence of digital avatars has raised an exponential increase in the demand for human point clouds with realistic and intricate details. The compression of such data becomes challenging with overwhelming data amoun…

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning

2025-05-21 · Chen Shani, Dan Jurafsky, Yann Lecun, Ravid Shwartz-Ziv

Humans organize knowledge into compact categories through semantic compression by mapping diverse instances to abstract representations while preserving meaning (e.g., robin and blue jay are both birds; most birds can fl…

Semantic Compression

Constrained Semantic Decompression in LLMs through Persian Proverb-Conditioned Story Generation

2026-06-10 · Zahra Habibzadeh, Paria Khoshtab, Amir Mesbah, Yadollah Yaghoobzadeh arxiv

Transforming a dense, abstract proverb into an engaging and morally faithful narrative requires deep cultural understanding and robust semantic grounding. We frame this problem as a \emph{constrained semantic decompressi…

Story Generation