paper-with-me

홈 › Papers

Protecting the integrity of the training procedure of neural networks

2020-05-14 · Christian Berghoff

Due to significant improvements in performance in recent years, neural networks are currently used for an ever-increasing number of applications. However, neural networks have the drawback that their decisions are not readily interpretable and traceable for a human. This creates several problems, for instance in terms of safety and IT security for high-risk applications, where assuring these properties is crucial. One of the most striking IT security problems aggravated by the opacity of neural networks is the possibility of so-called poisoning attacks during the training phase, where an attacker inserts specially crafted data to manipulate the resulting model. We propose an approach to this problem which allows provably verifying the integrity of the training procedure by making use of standard cryptographic mechanisms.

📄 PDF Abstract BibTeX arXiv:2005.06928

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Privacy and Integrity Preserving Training Using Trusted Hardware

2021-05-01 · Hanieh Hashemi, Yongqin Wang, Murali Annavaram

Privacy and security-related concerns are growing as machine learning reaches diverse application domains. The data holders want to train with private data while exploiting accelerators, such as GPUs, that are hosted in …

BIG-bench Machine Learning

DarKnight: An Accelerated Framework for Privacy and Integrity Preserving Deep Learning Using Trusted Hardware

2022-06-30 · Hanieh Hashemi, Yongqin Wang, Murali Annavaram

Privacy and security-related concerns are growing as machine learning reaches diverse application domains. The data holders want to train or infer with private data while exploiting accelerators, such as GPUs, that are h…

Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generation

2024-02-23 · Aditya Desu, Xuanli He, Qiongkai Xu, Wei Lu

As machine- and AI-generated content proliferates, protecting the intellectual property of generative models has become imperative, yet verifying data ownership poses formidable challenges, particularly in cases of unaut…

Misinformation

MCIP: Protecting MCP Safety via Model Contextual Integrity Protocol

2025-05-20 · Huihao Jing, Haoran Li, Wenbin Hu, Qi Hu 외

As Model Context Protocol (MCP) introduces an easy-to-use ecosystem for users and developers, it also brings underexplored safety risks. Its decentralized architecture, which separates clients and servers, poses unique c…

From Privacy to Workflow Integrity: Communication-Graph Metadata in Autonomous Agent Interoperability

2026-06-05 · Bijaya Dangol arxiv

Agent-interoperability protocols such as A2A and MCP standardize what agents say to one another but assume address-based transport. Whether over HTTP(S) or a content-protecting binding such as MLS-based SLIM, these trans…