paper-with-me

Papers

Segmentations-Leak: Membership Inference Attacks and Defenses in Semantic Image Segmentation

2019-12-20 · ECCV 2020 8 · Yang He, Shadi Rahimian, Bernt Schiele, Mario Fritz

Today's success of state of the art methods for semantic segmentation is driven by large datasets. Data is considered an important asset that needs to be protected, as the collection and annotation of such datasets comes at significant efforts and associated costs. In addition, visual data might contain private or sensitive information, that makes it equally unsuited for public release. Unfortunately, recent work on membership inference in the broader area of adversarial machine learning and inference attacks on machine learning models has shown that even black box classifiers leak information on the dataset that they were trained on. We show that such membership inference attacks can be successfully carried out on complex, state of the art models for semantic segmentation. In order to mitigate the associated risks, we also study a series of defenses against such membership inference attacks and find effective counter measures against the existing risks with little effect on the utility of the segmentation method. Finally, we extensively evaluate our attacks and defenses on a range of relevant real-world datasets: Cityscapes, BDD100K, and Mapillary Vistas.

📄 PDF Abstract BibTeX arXiv:1912.09685

Code (1)

SSAW14/segmentation_membership_inference 공식 구현 pytorch

Tasks

BIG-bench Machine LearningImage SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Label-Only Membership Inference Attacks

2020-07-28 · Christopher A. Choquette-Choo, Florian Tramer, Nicholas Carlini, Nicolas Papernot

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership infere…

L2 Regularization

Analyzing Leakage of Personally Identifiable Information in Language Models

2023-02-01 · Nils Lukas, Ahmed Salem, Robert Sim, Shruti Tople 외

Language Models (LMs) have been shown to leak information about training data through sentence-level membership inference and reconstruction attacks. Understanding the risk of LMs leaking Personally Identifiable Informat…

Sentence

Membership Leakage in Label-Only Exposures

2020-07-30 · Zheng Li, Yang Zhang

Machine learning (ML) has been widely adopted in various privacy-critical applications, e.g., face recognition and medical image analysis. However, recent research has shown that ML models are vulnerable to attacks again…

Face RecognitionInference AttackMedical Image Analysis

Evaluations of Machine Learning Privacy Defenses are Misleading

2024-04-26 · Michael Aerni, Jie Zhang, Florian Tramèr

Empirical defenses for machine learning privacy forgo the provable guarantees of differential privacy in the hope of achieving higher utility while resisting realistic adversaries. We identify severe pitfalls in existing…

Membership-Doctor: Comprehensive Assessment of Membership Inference Against Machine Learning Models

2022-08-22 · Xinlei He, Zheng Li, Weilin Xu, Cory Cornelius 외

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to infer whether an input sample was used to train the model. Over the pas…

Data Augmentation