paper-with-me

홈 › Papers

Identifying and Mitigating the Security Risks of Generative AI

2023-08-28 · Clark Barrett, Brad Boyd, Elie Burzstein, Nicholas Carlini, Brad Chen, Jihye Choi, Amrita Roy Chowdhury, Mihai Christodorescu, Anupam Datta, Soheil Feizi, Kathleen Fisher, Tatsunori Hashimoto, Dan Hendrycks, Somesh Jha, Daniel Kang, Florian Kerschbaum, Eric Mitchell, John Mitchell, Zulfikar Ramzan, Khawaja Shams, Dawn Song, Ankur Taly, Diyi Yang

Every major technical invention resurfaces the dual-use dilemma -- the new technology has the potential to be used for good as well as for harm. Generative AI (GenAI) techniques, such as large language models (LLMs) and diffusion models, have shown remarkable capabilities (e.g., in-context learning, code-completion, and text-to-image generation and editing). However, GenAI can be used just as well by attackers to generate new attacks and increase the velocity and efficacy of existing attacks. This paper reports the findings of a workshop held at Google (co-organized by Stanford University and the University of Wisconsin-Madison) on the dual-use dilemma posed by GenAI. This paper is not meant to be comprehensive, but is rather an attempt to synthesize some of the interesting findings from the workshop. We discuss short-term and long-term goals for the community on this topic. We hope this paper provides both a launching point for a discussion on this important topic as well as interesting problems that the research community can work to address.

📄 PDF Abstract BibTeX arXiv:2308.14840

Code (0)

등록된 구현이 없습니다.

Tasks

Code CompletionImage GenerationIn-Context LearningText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Security Risks Concerns of Generative AI in the IoT

2024-03-29 · Honghui Xu, Yingshu Li, Olusesi Balogun, Shaoen Wu 외

In an era where the Internet of Things (IoT) intersects increasingly with generative Artificial Intelligence (AI), this article scrutinizes the emergent security risks inherent in this integration. We explore how generat…

A Formal Framework for Assessing and Mitigating Emergent Security Risks in Generative AI Models: Bridging Theory and Dynamic Risk Mitigation

2024-10-15 · Aviral Srivastava, Sourav Panda

As generative AI systems, including large language models (LLMs) and diffusion models, advance rapidly, their growing adoption has led to new and complex security risks often overlooked in traditional AI risk assessment …

Anomaly DetectionRed Teaming

Exposing the Impact of GenAI for Cybercrime: An Investigation into the Dark Side

2025-05-29 · Truong, Luu, Binny M. Samuel

In recent years, the rapid advancement and democratization of generative AI models have sparked significant debate over safety, ethical risks, and dual-use concerns, particularly in the context of cybersecurity. While an…

Experimental DesignTime Series Analysis

Prioritizing High-Consequence Biological Capabilities in Evaluations of Artificial Intelligence Models

2024-05-25 · Jaspreet Pannu, Doni Bloomfield, Alex Zhu, Robert MacKnight 외

As a result of rapidly accelerating AI capabilities, over the past year, national governments and multinational bodies have announced efforts to address safety, security and ethics issues related to AI models. One high p…

Ethics

Red-Teaming for Generative AI: Silver Bullet or Security Theater?

2024-01-29 · Michael Feffer, Anusha Sinha, Wesley Hanwen Deng, Zachary C. Lipton 외

In response to rising concerns surrounding the safety, security, and trustworthiness of Generative AI (GenAI) models, practitioners and regulators alike have pointed to AI red-teaming as a key component of their strategi…

Red Teaming