DIPBox: A Multi-scale Testing Framework for Tracking Dataset Regeneration
Training datasets have tremendous proprietary value and are vulnerable to unauthorized copying. Existing defenses mainly focus on tracking individual data points, but pay little attention to the threat of dataset regeneration. Through a measurement study of public tumor datasets, we identify substantial real-world partial-dataset replication, raising concerns about potential license noncompliance. To counter the challenge of tracking previously unknown adversarial regeneration, our key insight is that regeneration that preserves model utility inevitably preserves measurable signals across multiple feature scales. We categorize these dataset features into sample-, set-, and distribution-level features and design four similarity metrics to accurately identify regeneration. Based on these metrics, we develop DIPBox, which to our knowledge is the first testing framework that tracks regeneration suspects via multi-scale similarity testing across a spectrum of defender access settings, from limited to full information. We further provide a learning-theoretic analysis that justifies these multi-scale metrics and formalizes an inherent utility--divergence trade-off, implying fundamental limits on evasive regeneration. Extensive experiments on 16 vision and text base datasets, 320 regenerated datasets, and 590 derived models validate that DIPBox outperforms previous solutions while characterizing its robustness and limits under three adaptive attacks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
On the Effectiveness of Tracking and Testing in SEIR Models
We study the effectiveness of tracking and testing in mitigating or suppressing epidemic outbreaks, in combination with or as an alternative to quarantines and global lockdowns. We study these intervention methods on a n…
A Robust Deep Networks based Multi-Object MultiCamera Tracking System for City Scale Traffic
Vision sensors are becoming more important in Intelligent Transportation Systems (ITS) for traffic monitoring, management, and optimization as the number of network cameras continues to rise. However, manual object track…
object-detectionObject DetectionObject TrackingTransfer LearningSCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation
Reliable performance evaluation is a central bottleneck for deploying robot-learning policies in real-world conditions. Real-world testing is faithful but costly and difficult to scale, whereas simulation-based testing s…
Autonomous DrivingEvent Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
Tracking using bio-inspired event cameras has drawn more and more attention in recent years. Existing works either utilize aligned RGB and event data for accurate tracking or directly learn an event-based tracker. The fi…
Knowledge DistillationObject TrackingTransfer LearningVisual Object Tracking+1Multiple-Kernel Based Vehicle Tracking Using 3D Deformable Model and Camera Self-Calibration
Tracking of multiple objects is an important application in AI City geared towards solving salient problems related to safety and congestion in an urban environment. Frequent occlusion in traffic surveillance has been a …
Ensemble Learningobject-detectionObject Detection