paper-with-me

홈 › Papers

Instance-Level Data-Use Auditing of Visual ML Models

2025-03-28 · Zonghao Huang, Neil Zhenqiang Gong, Michael K. Reiter

The growing trend of legal disputes over the unauthorized use of data in machine learning (ML) systems highlights the urgent need for reliable data-use auditing mechanisms to ensure accountability and transparency in ML. In this paper, we present the first proactive instance-level data-use auditing method designed to enable data owners to audit the use of their individual data instances in ML models, providing more fine-grained auditing results. Our approach integrates any black-box membership inference technique with a sequential hypothesis test, providing a quantifiable and tunable false-detection rate. We evaluate our method on three types of visual ML models: image classifiers, visual encoders, and Contrastive Image-Language Pretraining (CLIP) models. In additional, we apply our method to evaluate the performance of two state-of-the-art approximate unlearning methods. Our findings reveal that neither method successfully removes the influence of the unlearned data instances from image classifiers and CLIP models even if sacrificing model utility by $10.33\%$.

📄 PDF Abstract BibTeX arXiv:2503.22413

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Breaking Déjà Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning

2026-07-14 · Sania Waheed, Michael Milford, Sarvapali D. Ramchurn, Shoaib Ehsan arxiv

Visual place recognition (VPR) is a key enabler of accurate localization and long-term autonomous navigation in robotics applications, such as loop closure detection for simultaneous localisation and mapping (SLAM). Howe…

Visual Place RecognitionImage Matching

Auditing Near-Optimal Policies Can Be Exponentially Hard: Conditional Query Lower Bounds via Occupancy Rashomon Capacity

2026-05-29 · Ibne Farabi Shihab, Sanjeda Akter, Anuj Sharma arxiv

When many reinforcement-learning policies achieve near-optimal return, a post-hoc auditor may have to distinguish among many behaviorally distinct but return-equivalent policies. We formalize this phenomenon through an o…

Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications

2025-02-02 · Yixin Wu, Ziqing Yang, Yun Shen, Michael Backes 외

Large language models (LLMs) have facilitated the generation of high-quality, cost-effective synthetic data for developing downstream models and conducting statistical analyses in various domains. However, the increased …

Data Visualizationtext-classificationText ClassificationText Summarization

From Accuracy to Visual Dependence: Auditing and Filtering Modality Collapse in Traffic VideoQA

2026-06-29 · Sena Korkut, María Alejandra Bravo Sarmiento, Sanghwan Kim, Zeynep Akata arxiv

High benchmark accuracy does not guarantee genuine use of visual evidence. We study this problem in traffic accident Video Question Answering (VideoQA), where correct answers should depend on scene-specific visual eviden…

Video Question AnsweringVisual Grounding

Auditing Black-Box Prediction Models for Data Minimization Compliance

2021-12-01 · NeurIPS 2021 12 · Bashir Rastegarpanah, Krishna Gummadi, Mark Crovella

In this paper, we focus on auditing black-box prediction models for compliance with the GDPR’s data minimization principle. This principle restricts prediction models to use the minimal information that is necessary for …

ImputationPrediction