paper-with-me

홈 › Papers

Hidden in Plain Sight: Undetectable Adversarial Bias Attacks on Vulnerable Patient Populations

2024-02-08 · Pranav Kulkarni, Andrew Chan, Nithya Navarathna, Skylar Chan, Paul H. Yi, Vishwa S. Parekh

The proliferation of artificial intelligence (AI) in radiology has shed light on the risk of deep learning (DL) models exacerbating clinical biases towards vulnerable patient populations. While prior literature has focused on quantifying biases exhibited by trained DL models, demographically targeted adversarial bias attacks on DL models and its implication in the clinical environment remains an underexplored field of research in medical imaging. In this work, we demonstrate that demographically targeted label poisoning attacks can introduce undetectable underdiagnosis bias in DL models. Our results across multiple performance metrics and demographic groups like sex, age, and their intersectional subgroups show that adversarial bias attacks demonstrate high-selectivity for bias in the targeted group by degrading group model performance without impacting overall model performance. Furthermore, our results indicate that adversarial bias attacks result in biased DL models that propagate prediction bias even when evaluated with external datasets.

📄 PDF Abstract BibTeX arXiv:2402.05713

Code (1)

um2ii/hiddeninplainsight 공식 구현 tf

Similar Papers 제목 키워드 기반

Planting Undetectable Backdoors in Machine Learning Models

2022-04-14 · Shafi Goldwasser, Michael P. Kim, Vinod Vaikuntanathan, Or Zamir

Given the computational cost and technical expertise required to train machine learning models, users may delegate the task of learning to a service provider. We show how a malicious learner can plant an undetectable bac…

Adversarial RobustnessBIG-bench Machine Learning

Affine Transformation-based Perfectly Undetectable False Data Injection Attacks on Remote Manipulator Kinematic Control with Attack Detector

2024-05-17 · Jun Ueda, Jacob Blevins

This paper demonstrates the viability of perfectly undetectable affine transformation attacks against robotic manipulators where intelligent attackers can inject multiplicative and additive false data while remaining com…

Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMs

2024-10-02 · Yohan Mathew, Ollie Matthews, Robert McCarthy, Joan Velja 외

The rapid proliferation of frontier model agents promises significant societal advances but also raises concerns about systemic risks arising from unsafe interactions. Collusion to the disadvantage of others has been ide…

In-Context Reinforcement Learningreinforcement-learningReinforcement Learning

HAD-GAN: A Human-perception Auxiliary Defense GAN to Defend Adversarial Examples

2019-09-17 · Wanting Yu, Hongyi Yu, Lingyun Jiang, Mengli Zhang 외

Adversarial examples reveal the vulnerability and unexplained nature of neural networks. Studying the defense of adversarial examples is of considerable practical importance. Most adversarial examples that misclassify ne…

Exploring Adversarial Robustness of LiDAR-Camera Fusion Model in Autonomous Driving

2023-12-03 · Bo Yang, Xiaoyu Ji, Zizhi Jin, Yushi Cheng 외

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points ab…

3D Object DetectionAdversarial RobustnessAutonomous Drivingobject-detection+1