Autoregressive Linguistic Steganography Based on BERT and Consistency Coding
Linguistic steganography (LS) conceals the presence of communication by embedding secret information into a text. How to generate a high-quality text carrying secret information is a key problem. With the widespread application of deep learning in natural language processing, recent algorithms use a language model (LM) to generate the steganographic text, which provides a higher payload compared with many previous arts. However, the security still needs to be enhanced. To tackle with this problem, we propose a novel autoregressive LS algorithm based on BERT and consistency coding, which achieves a better trade-off between embedding payload and system security. In the proposed work, based on the introduction of the masked LM, given a text, we use consistency coding to make up for the shortcomings of block coding used in the previous work so that we can encode arbitrary-size candidate token set and take advantages of the probability distribution for information hiding. The masked positions to be embedded are filled with tokens determined by an autoregressive manner to enhance the connection between contexts and therefore maintain the quality of the text. Experimental results have shown that, compared with related works, the proposed work improves the fluency of the steganographic text while guaranteeing security, and also increases the embedding payload to a certain extent.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModellingLinguistic steganographyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Efficient Provably Secure Linguistic Steganography via Range Coding
Linguistic steganography involves embedding secret messages within seemingly innocuous texts to enable covert communication. Provable security, which is a long-standing goal and key motivation, has been extended to langu…
Neural Linguistic Steganography
Whereas traditional cryptography encrypts a secret message into an unintelligible form, steganography conceals that communication is taking place by encoding a secret message into a cover signal. Language is a particular…
Language ModelingLanguage ModellingLinguistic steganographyNear-imperceptible Neural Linguistic Steganography via Self-Adjusting Arithmetic Coding
Linguistic steganography studies how to hide secret messages in natural language cover texts. Traditional methods aim to transform a secret message into an innocent text via lexical substitution or syntactical modificati…
Language ModelingLanguage ModellingLinguistic steganographySemantic-Preserving Linguistic Steganography by Pivot Translation and Semantic-Aware Bins Coding
Linguistic steganography (LS) aims to embed secret information into a highly encoded text for covert communication. It can be roughly divided to two main categories, i.e., modification based LS (MLS) and generation based…
Language ModellingLinguistic steganographySteganalysisTranslation