paper-with-me

홈 › Papers

LoRAShield: Data-Free Editing Alignment for Secure Personalized LoRA Sharing

2025-07-05 · Jiahao Chen, Junhao Li, Yiming Wang, Yong Yang, Yi Jiang, Chunyi Zhou, Qingming Li, Tianyu Du, Shouling Ji arxiv

The proliferation of Low-Rank Adaptation (LoRA) models has democratized personalized text-to-image generation, enabling users to share lightweight models (e.g., personal portraits) on platforms like Civitai and Liblib. However, this "share-and-play" ecosystem introduces critical risks: benign LoRAs can be weaponized by adversaries to generate harmful content (e.g., political, defamatory imagery), undermining creator rights and platform safety. Existing defenses like concept-erasure methods focus on full diffusion models (DMs), neglecting LoRA's unique role as a modular adapter and its vulnerability to adversarial prompt engineering. To bridge this gap, we propose LoRAShield, the first data-free editing framework for securing LoRA models against misuse. Our platform-driven approach dynamically edits and realigns LoRA's weight subspace via adversarial optimization and semantic augmentation. Experimental results demonstrate that LoRAShield achieves remarkable effectiveness, efficiency, and robustness in blocking malicious generations without sacrificing the functionality of the benign task. By shifting the defense to platforms, LoRAShield enables secure, scalable sharing of personalized models, a critical step toward trustworthy generative ecosystems.

📄 PDF Abstract BibTeX arXiv:2507.07056

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image GenerationPrompt Engineering

Similar Papers 제목 키워드 기반

Tuning-free Instruction-based Video Editing Via Structural Noise Initialization and Guidance

2026-05-15 · Song Wu, Xinyu Chen, Qian Wang, Liang Li 외 arxiv

Video editing poses a significant challenge. While a series of tuning-free methods circumvent the need for extensive data collection and model training, they often underutilize the rich information embedded within noisy …

Training-Free Image Editing with Visual Context Integration and Concept Alignment

2026-04-06 · Rui Song, Guo-Hua Wang, Qing-Guo Chen, Weihua Luo 외 arxiv

In image editing, it is essential to incorporate a context image to convey the user's precise requirements, such as subject appearance or image style. Existing training-based visual context-aware editing methods incur da…

Image Editing

SecureT2I: No More Unauthorized Manipulation on AI Generated Images from Prompts

2025-07-04 · Xiaodong Wu, Xiangman Li, Qi Li, Jianbing Ni 외 arxiv

Text-guided image manipulation with diffusion models enables flexible and precise editing based on prompts, but raises ethical and copyright concerns due to potential unauthorized modifications. To address this, we propo…

Image Manipulation

MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance

2023-12-18 · Qi Mao, Lan Chen, YuChao Gu, Zhen Fang 외

Recent diffusion-based image editing approaches have exhibited impressive editing capabilities in images with simple compositions. However, localized editing in complex scenarios has not been well-studied in the literatu…

Emergent misalignment as prompt sensitivity: A research note

2025-07-06 · Tim Wyse, Twm Stone, Anna Soligo, Daniel Tan arxiv

Betley et al. (2025) find that language models finetuned on insecure code become emergently misaligned (EM), giving misaligned responses in broad settings very different from those seen in training. However, it remains u…