paper-with-me

홈 › Papers

When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm

2026-03-25 · Ye Leng, Junjie Chu, Mingjie Li, Chenhao Lin, Chao Shen, Michael Backes, Yun Shen, Yang Zhang arxiv

Recently, multimodal large language models (MLLMs) have emerged as a unified paradigm for language and image generation. Compared with diffusion models, MLLMs possess a much stronger capability for semantic understanding, enabling them to process more complex textual inputs and comprehend richer contextual meanings. However, this enhanced semantic ability may also introduce new and potentially greater safety risks. Taking diffusion models as a reference point, we systematically analyze and compare the safety risks of emerging MLLMs along two dimensions: unsafe content generation and fake image synthesis. Across multiple unsafe generation benchmark datasets, we observe that MLLMs tend to generate more unsafe images than diffusion models. This difference partly arises because diffusion models often fail to interpret abstract prompts, producing corrupted outputs, whereas MLLMs can comprehend these prompts and generate unsafe content. For current advanced fake image detectors, MLLM-generated images are also notably harder to identify. Even when detectors are retrained with MLLMs-specific data, they can still be bypassed by simply providing MLLMs with longer and more descriptive inputs. Our measurements indicate that the emerging safety risks of the cutting-edge generative paradigm, MLLMs, have not been sufficiently recognized, posing new challenges to real-world safety.

📄 PDF Abstract BibTeX arXiv:2603.24079

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safety

2025-10-21 · Shruti Palaskar, Leon Gatys, Mona Abdelrahman, Mar Jacobo 외 arxiv

Safety evaluation of multimodal foundation models often treats vision and language inputs separately, missing risks from joint interpretation where benign content becomes harmful in combination. Existing approaches also …

MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language Models

2024-03-06 · Tessa Han, Aounon Kumar, Chirag Agarwal, Himabindu Lakkaraju

As large language models (LLMs) develop increasingly sophisticated capabilities and find applications in medical settings, it becomes important to assess their medical safety due to their far-reaching implications for pe…

EthicsGeneral Knowledge

Evaluating Control Protocols for Untrusted AI Agents

2025-11-04 · Jon Kutasov, Chloe Loughridge, Yuqi Sun, Henry Sleight 외 arxiv

As AI systems become more capable and widely deployed as agents, ensuring their safe operation becomes critical. AI control offers one approach to mitigating the risk from untrusted AI agents by monitoring their actions …

Risk-Aware Safety Filters with Poisson Safety Functions and Laplace Guidance Fields

2025-10-29 · Gilbert Bahati, Ryan M. Bena, Meg Wilkinson, Pol Mestres 외 arxiv

Robotic systems navigating in real-world settings require a semantic understanding of their environment to properly determine safe actions. This work aims to develop the mathematical underpinnings of such a representatio…

LADRI: LeArning-based Dynamic Risk Indicator in Automated Driving System

2024-01-04 · Anil Ranjitbhai Patel, Peter Liggesmeyer

As the horizon of intelligent transportation expands with the evolution of Automated Driving Systems (ADS), ensuring paramount safety becomes more imperative than ever. Traditional risk assessment methodologies, primaril…

Navigate