paper-with-me

홈 › Papers

New Emerged Security and Privacy of Pre-trained Model: a Survey and Outlook

2024-11-12 · Meng Yang, Tianqing Zhu, Chi Liu, Wanlei Zhou, Shui Yu, Philip S. Yu

Thanks to the explosive growth of data and the development of computational resources, it is possible to build pre-trained models that can achieve outstanding performance on various tasks, such as neural language processing, computer vision, and more. Despite their powerful capabilities, pre-trained models have also sparked attention to the emerging security challenges associated with their real-world applications. Security and privacy issues, such as leaking privacy information and generating harmful responses, have seriously undermined users' confidence in these powerful models. Concerns are growing as model performance improves dramatically. Researchers are eager to explore the unique security and privacy issues that have emerged, their distinguishing factors, and how to defend against them. However, the current literature lacks a clear taxonomy of emerging attacks and defenses for pre-trained models, which hinders a high-level and comprehensive understanding of these questions. To fill the gap, we conduct a systematical survey on the security risks of pre-trained models, proposing a taxonomy of attack and defense methods based on the accessibility of pre-trained models' input and weights in various security test scenarios. This taxonomy categorizes attacks and defenses into No-Change, Input-Change, and Model-Change approaches. With the taxonomy analysis, we capture the unique security and privacy issues of pre-trained models, categorizing and summarizing existing security issues based on their characteristics. In addition, we offer a timely and comprehensive review of each category's strengths and limitations. Our survey concludes by highlighting potential new research opportunities in the security and privacy of pre-trained models.

📄 PDF Abstract BibTeX arXiv:2411.07691

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

When Machine Learning Meets Privacy: A Survey and Outlook

2020-11-24 · Bo Liu, Ming Ding, Sina Shaham, Wenny Rahayu 외

The newly emerged machine learning (e.g. deep learning) methods have become a strong driving force to revolutionize a wide range of industries, such as smart healthcare, financial technology, and surveillance systems. Me…

BIG-bench Machine LearningSurvey

On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook

2023-07-31 · Mingyuan Fan, Chengyu Wang, Cen Chen, Yang Liu 외

Diffusion models and large language models have emerged as leading-edge generative models, revolutionizing various aspects of human life. However, the practical implementations of these models have also exposed inherent …

Fairness

Security and Privacy Problems in Voice Assistant Applications: A Survey

2023-04-19 · Jingjin Li, Chao Chen, Lei Pan, Mostafa Rahimi Azghadi 외

Voice assistant applications have become omniscient nowadays. Two models that provide the two most important functions for real-life applications (i.e., Google Home, Amazon Alexa, Siri, etc.) are Automatic Speech Recogni…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speaker Identificationspeech-recognition+2

Security of Internet of Agents: Attacks and Countermeasures

2025-05-12 · Yuntao Wang, Yanghe Pan, Shaolong Guo, Zhou Su

With the rise of large language and vision-language models, AI agents have evolved into autonomous, interactive systems capable of perception, reasoning, and decision-making. As they proliferate across virtual and physic…

Decision MakingPrivacy Preserving

Federated Learning for Smart Grid: A Survey on Applications and Potential Vulnerabilities

2024-09-16 · Zikai Zhang, Suman Rath, Jiaohao Xu, Tingsong Xiao

The Smart Grid (SG) is a critical energy infrastructure that collects real-time electricity usage data to forecast future energy demands using information and communication technologies (ICT). Due to growing concerns abo…

Federated LearningSurvey