paper-with-me

홈 › Papers

SSL-Auth: An Authentication Framework by Fragile Watermarking for Pre-trained Encoders in Self-supervised Learning

2023-08-09 · Xiaobei Li, Changchun Yin, Liyue Zhu, Xiaogang Xu, Liming Fang, Run Wang, Chenhao Lin

Self-supervised learning (SSL), a paradigm harnessing unlabeled datasets to train robust encoders, has recently witnessed substantial success. These encoders serve as pivotal feature extractors for downstream tasks, demanding significant computational resources. Nevertheless, recent studies have shed light on vulnerabilities in pre-trained encoders, including backdoor and adversarial threats. Safeguarding the intellectual property of encoder trainers and ensuring the trustworthiness of deployed encoders pose notable challenges in SSL. To bridge these gaps, we introduce SSL-Auth, the first authentication framework designed explicitly for pre-trained encoders. SSL-Auth leverages selected key samples and employs a well-trained generative network to reconstruct watermark information, thus affirming the integrity of the encoder without compromising its performance. By comparing the reconstruction outcomes of the key samples, we can identify any malicious alterations. Comprehensive evaluations conducted on a range of encoders and diverse downstream tasks demonstrate the effectiveness of our proposed SSL-Auth.

📄 PDF Abstract BibTeX arXiv:2308.04673

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

Social Media Authentication and Combating Deepfakes using Semi-fragile Invisible Image Watermarking

2024-10-02 · Aakash Varma Nadimpalli, Ajita Rattani

With the significant advances in deep generative models for image and video synthesis, Deepfakes and manipulated media have raised severe societal concerns. Conventional machine learning classifiers for deepfake detectio…

DeepFake DetectionFace Swapping

Image content dependent semi-fragile watermarking with localized tamper detection

2021-06-27 · Samira Hosseini, Mojtaba Mahdavi

Content-independent watermarks and block-wise independency can be considered as vulnerabilities in semi-fragile watermarking methods. In this paper to achieve the objectives of semi-fragile watermarking techniques, a met…

FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes

2022-04-05 · Paarth Neekhara, Shehzeen Hussain, Xinqiao Zhang, Ke Huang 외

Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. There have been several attempts at combating Deepfakes using machine learning…

Face SwappingImage CompressionImage Generation

Reversible Watermarking in Deep Convolutional Neural Networks for Integrity Authentication

2021-04-09 · Xiquan Guan, Huamin Feng, Weiming Zhang, Hang Zhou 외

Deep convolutional neural networks have made outstanding contributions in many fields such as computer vision in the past few years and many researchers published well-trained network for downloading. But recent studies …

Model Compression

WSMN: An optimized multipurpose blind watermarking in Shearlet domain using MLP and NSGA-II

2020-05-07 · Behrouz Bolourian Haghighi, Amir Hossein Taherinia, Ahad Harati, Modjtaba Rouhani

Digital watermarking is a remarkable issue in the field of information security to avoid the misuse of images in multimedia networks. Although access to unauthorized persons can be prevented through cryptography, it cann…

QuantizationSSIM