paper-with-me

홈 › Papers

Mitigating Low-Frequency Bias: Feature Recalibration and Frequency Attention Regularization for Adversarial Robustness

2024-07-04 · Kejia Zhang, Juanjuan Weng, Yuanzheng Cai, Zhiming Luo, Shaozi Li

Ensuring the robustness of deep neural networks against adversarial attacks remains a fundamental challenge in computer vision. While adversarial training (AT) has emerged as a promising defense strategy, our analysis reveals a critical limitation: AT-trained models exhibit a bias toward low-frequency features while neglecting high-frequency components. This bias is particularly concerning as each frequency component carries distinct and crucial information: low-frequency features encode fundamental structural patterns, while high-frequency features capture intricate details and textures. To address this limitation, we propose High-Frequency Feature Disentanglement and Recalibration (HFDR), a novel module that strategically separates and recalibrates frequency-specific features to capture latent semantic cues. We further introduce frequency attention regularization to harmonize feature extraction across the frequency spectrum and mitigate the inherent low-frequency bias of AT. Extensive experiments demonstrate our method's superior performance against white-box attacks and transfer attacks, while exhibiting strong generalization capabilities across diverse scenarios.

📄 PDF Abstract BibTeX arXiv:2407.04016

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial RobustnessDisentanglement

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Rethinking Bias in Generative Data Augmentation for Medical AI: a Frequency Recalibration Method

2025-11-15 · Chi Liu, Jincheng Liu, Congcong Zhu, Minghao Wang 외 arxiv

Developing Medical AI relies on large datasets and easily suffers from data scarcity. Generative data augmentation (GDA) using AI generative models offers a solution to synthesize realistic medical images. However, the b…

Medical Image ClassificationData Augmentation

On the study of frequency control and spectral bias in Wavelet-Based Kolmogorov Arnold networks: A path to physics-informed KANs

2025-02-01 · Juan Daniel Meshir, Abel Palafox, Edgar Alejandro Guerrero

Spectral bias, the tendency of neural networks to prioritize learning low-frequency components of functions during the initial training stages, poses a significant challenge when approximating solutions with high-frequen…

Kolmogorov-Arnold Networks

FreqGRL: Suppressing Low-Frequency Bias and Mining High-Frequency Knowledge for Cross-Domain Few-Shot Learning

2025-11-10 · Siqi Hui, Sanping Zhou, Ye deng, Wenli Huang 외 arxiv

Cross-domain few-shot learning (CD-FSL) aims to recognize novel classes with only a few labeled examples under significant domain shifts. While recent approaches leverage a limited amount of labeled target-domain data to…

cross-domain few-shot learningRepresentation LearningDomain Generalization

Mitigating Frequency Bias in Next-Basket Recommendation via Deconfounders

2022-11-16 · Xiaohan Li, Zheng Liu, Luyi Ma, Kaushiki Nag 외

Recent studies on Next-basket Recommendation (NBR) have achieved much progress by leveraging Personalized Item Frequency (PIF) as one of the main features, which measures the frequency of the user's interactions with the…

Causal InferenceFairnessNext-basket recommendationRecommendation Systems

Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing

2024-10-15 · Richard Diehl Martinez, Zebulon Goriely, Andrew Caines, Paula Buttery 외

Language models strongly rely on frequency information because they maximize the likelihood of tokens during pre-training. As a consequence, language models tend to not generalize well to tokens that are seldom seen duri…

Language ModelingLanguage ModellingSentence