paper-with-me

Papers

Principal Eigenvalue Regularization for Improved Worst-Class Certified Robustness of Smoothed Classifiers

2025-03-21 · Gaojie Jin, Tianjin Huang, Ronghui Mu, Xiaowei Huang

Recent studies have identified a critical challenge in deep neural networks (DNNs) known as ``robust fairness", where models exhibit significant disparities in robust accuracy across different classes. While prior work has attempted to address this issue in adversarial robustness, the study of worst-class certified robustness for smoothed classifiers remains unexplored. Our work bridges this gap by developing a PAC-Bayesian bound for the worst-class error of smoothed classifiers. Through theoretical analysis, we demonstrate that the largest eigenvalue of the smoothed confusion matrix fundamentally influences the worst-class error of smoothed classifiers. Based on this insight, we introduce a regularization method that optimizes the largest eigenvalue of smoothed confusion matrix to enhance worst-class accuracy of the smoothed classifier and further improve its worst-class certified robustness. We provide extensive experimental validation across multiple datasets and model architectures to demonstrate the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2503.17172

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial RobustnessFairness

Similar Papers 제목 키워드 기반

Eigenvalue and Generalized Eigenvalue Problems: Tutorial

2019-03-25 · Benyamin Ghojogh, Fakhri Karray, Mark Crowley

This paper is a tutorial for eigenvalue and generalized eigenvalue problems. We first introduce eigenvalue problem, eigen-decomposition (spectral decomposition), and generalized eigenvalue problem. Then, we mention the o…

BIG-bench Machine LearningMatrix Factorization / Decomposition

Eigenvalue Decay Implies Polynomial-Time Learnability for Neural Networks

2017-08-11 · NeurIPS 2017 12 · Surbhi Goel, Adam Klivans

We consider the problem of learning function classes computed by neural networks with various activations (e.g. ReLU or Sigmoid), a task believed to be computationally intractable in the worst-case. A major open problem …

Improved Convergence Speed of Fully Symmetric Learning Rules for Principal Component Analysis

2020-07-18 · Ralf Möller

Fully symmetric learning rules for principal component analysis can be derived from a novel objective function suggested in our previous work. We observed that these learning rules suffer from slow convergence for covari…

Principal eigenstate classical shadows

2024-05-22 · Daniel Grier, Hakop Pashayan, Luke Schaeffer

Given many copies of an unknown quantum state $\rho$, we consider the task of learning a classical description of its principal eigenstate. Namely, assuming that $\rho$ has an eigenstate $|\phi\rangle$ with (unknown) eig…

Optimal detection of sparse principal components in high dimension

2012-02-23 · Quentin Berthet, Philippe Rigollet

We perform a finite sample analysis of the detection levels for sparse principal components of a high-dimensional covariance matrix. Our minimax optimal test is based on a sparse eigenvalue statistic. Alas, computing thi…

Vocal Bursts Intensity Prediction