paper-with-me

홈 › Papers

DeepHider: A Covert NLP Watermarking Framework Based on Multi-task Learning

2022-08-09 · Long Dai, Jiarong Mao, Xuefeng Fan, Xiaoyi Zhou

Natural language processing (NLP) technology has shown great commercial value in applications such as sentiment analysis. But NLP models are vulnerable to the threat of pirated redistribution, damaging the economic interests of model owners. Digital watermarking technology is an effective means to protect the intellectual property rights of NLP model. The existing NLP model protection mainly designs watermarking schemes by improving both security and robustness purposes, however, the security and robustness of these schemes have the following problems, respectively: (1) Watermarks are difficult to defend against fraudulent declaration by adversary and are easily detected and blocked from verification by human or anomaly detector during the verification process. (2) The watermarking model cannot meet multiple robustness requirements at the same time. To solve the above problems, this paper proposes a novel watermarking framework for NLP model based on the over-parameterization of depth model and the multi-task learning theory. Specifically, a covert trigger set is established to realize the perception-free verification of the watermarking model, and a novel auxiliary network is designed to improve the robustness and security of the watermarking model. The proposed framework was evaluated on two benchmark datasets and three mainstream NLP models, and the results show that the framework can successfully validate model ownership with 100% validation accuracy and advanced robustness and security without compromising the host model performance.

📄 PDF Abstract BibTeX arXiv:2208.04676

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModellingLearning TheoryMulti-Task LearningSentiment Analysis

Similar Papers 제목 키워드 기반

RIGA: Covert and Robust White-Box Watermarking of Deep Neural Networks

2019-10-31 · Tianhao Wang, Florian Kerschbaum

Watermarking of deep neural networks (DNN) can enable their tracing once released by a data owner. In this paper, we generalize white-box watermarking algorithms for DNNs, where the data owner needs white-box access to t…

Inference Attack

De-mark: Watermark Removal in Large Language Models

2024-10-17 · Ruibo Chen, Yihan Wu, Junfeng Guo, Heng Huang

Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models (LMs). However, the robustness of the watermarking sch…

A Deep Learning-based Audio-in-Image Watermarking Scheme

2021-10-06 · Arjon Das, Xin Zhong

This paper presents a deep learning-based audio-in-image watermarking scheme. Audio-in-image watermarking is the process of covertly embedding and extracting audio watermarks on a cover-image. Using audio watermarks can …

Deep Learning

A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models

2023-10-11 · Yihan Wu, Zhengmian Hu, Junfeng Guo, Hongyang Zhang 외

Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models. A challenge in the domain lies in preserving the dist…

Language ModelingLanguage Modelling

An Automated and Robust Image Watermarking Scheme Based on Deep Neural Networks

2020-07-05 · Xin Zhong, Pei-Chi Huang, Spyridon Mastorakis, Frank Y. Shih

Digital image watermarking is the process of embedding and extracting a watermark covertly on a cover-image. To dynamically adapt image watermarking algorithms, deep learning-based image watermarking schemes have attract…

Deep Learning