Safe machine learning model release from Trusted Research Environments: The SACRO-ML package
We present SACRO-ML, an integrated suite of open source Python tools to facilitate the statistical disclosure control (SDC) of machine learning (ML) models trained on confidential data prior to public release. SACRO-ML combines (i) a SafeModel package that extends commonly used ML models to provide ante-hoc SDC by assessing the vulnerability of disclosure posed by the training regime; and (ii) an Attacks package that provides post-hoc SDC by rigorously assessing the empirical disclosure risk of a model through a variety of simulated attacks after training. The SACRO-ML code and documentation are available under an MIT license at https://github.com/AI-SDC/SACRO-ML
Code (2)
Similar Papers 제목 키워드 기반
Machine Learning Models Disclosure from Trusted Research Environments (TRE), Challenges and Opportunities
Artificial intelligence (AI) applications in healthcare and medicine have increased in recent years. To enable access to personal data, Trusted Research environments (TREs) provide safe and secure environments in which r…
BIG-bench Machine LearningDecision MakingPrivacy PreservingConfidential Machine Learning Computation in Untrusted Environments: A Systems Security Perspective
As machine learning (ML) technologies and applications are rapidly changing many computing domains, security issues associated with ML are also emerging. In the domain of systems security, many endeavors have been made t…
BIG-bench Machine LearningLinuxArena: A Control Setting for AI Agents in Live Production Software Environments
We introduce LinuxArena, a control setting in which agents operate directly on live, multi-service production environments. LinuxArena contains 20 environments, 1,671 main tasks representing legitimate software engineeri…
Safeguards Based on Copyable Context Cannot Provide Reliable Safety for LLMs
Large language model safeguards decide whether to answer before seeing how an answer will be used. This creates a basic problem for dual-use tasks: the same answer can help an authorized professional or an attacker, whil…
When can we trust untrusted monitoring? A safety case sketch across collusion strategies
AIs are increasingly being deployed with greater autonomy and capabilities, which increases the risk that a misaligned AI may be able to cause catastrophic harm. Untrusted monitoring -- using one untrusted model to overs…