paper-with-me

Papers

The Forgotten Shield: Safety Grafting in Parameter-Space for Medical MLLMs

2025-12-05 · Jiale Zhao, Xing Mou, Jinlin Wu, Hongyuan Yu, Mingrui Sun, Yang Shi, Xuanwu Yin, Zhen Chen, Zhen Lei, Yaohua Wang arxiv

Medical Multimodal Large Language Models (Medical MLLMs) have achieved remarkable progress in specialized medical tasks; however, research into their safety has lagged, posing potential risks for real-world deployment. In this paper, we first establish a multidimensional evaluation framework to systematically benchmark the safety of current SOTA Medical MLLMs. Our empirical analysis reveals pervasive vulnerabilities across both general and medical-specific safety dimensions in existing models, particularly highlighting their fragility against cross-modality jailbreak attacks. Furthermore, we find that the medical fine-tuning process frequently induces catastrophic forgetting of the model's original safety alignment. To address this challenge, we propose a novel "Parameter-Space Intervention" approach for efficient safety re-alignment. This method extracts intrinsic safety knowledge representations from original base models and concurrently injects them into the target model during the construction of medical capabilities. Additionally, we design a fine-grained parameter search algorithm to achieve an optimal trade-off between safety and medical performance. Experimental results demonstrate that our approach significantly bolsters the safety guardrails of Medical MLLMs without relying on additional domain-specific safety data, while minimizing degradation to core medical performance.

📄 PDF Abstract BibTeX arXiv:2601.04199

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Efficient Dynamic Shielding for Parametric Safety Specifications

2025-05-28 · Davide Corsi, Kaushik Mallik, Andoni Rodriguez, Cesar Sanchez

Shielding has emerged as a promising approach for ensuring safety of AI-controlled autonomous systems. The algorithmic goal is to compute a shield, which is a runtime safety enforcement tool that needs to monitor and int…

Robot Navigation

Shielding for Higher-Order Safety

2026-08-04 · Filip Cano, Thomas A. Henzinger, Konstantin Kueffner arxiv

Safety shields are runtime enforcement mechanisms that restrict the actions of a controller to guarantee safety. Classical shields are usually synthesised for state predicates: the current physical state is either safe o…

UnlearnShield: Shielding Forgotten Privacy against Unlearning Inversion

2026-01-28 · Lulu Xue, Shengshan Hu, Wei Lu, Ziqi Zhou 외 arxiv

Machine unlearning is an emerging technique that aims to remove the influence of specific data from trained models, thereby enhancing privacy protection. However, recent research has uncovered critical privacy vulnerabil…

Safe Multi-Agent Reinforcement Learning via Shielding

2021-01-27 · Ingy Elsayed-Aly, Suda Bharadwaj, Christopher Amato, Rüdiger Ehlers 외

Multi-agent reinforcement learning (MARL) has been increasingly used in a wide range of safety-critical applications, which require guaranteed safety (e.g., no unsafe states are ever visited) during the learning process.…

Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Predictive Safety Shield for Dyna-Q Reinforcement Learning

2025-11-26 · Jin Pin, Krasowski Hanna, Vanneaux Elena arxiv

Obtaining safety guarantees for reinforcement learning is a major challenge to achieve applicability for real-world tasks. Safety shields extend standard reinforcement learning and achieve hard safety guarantees. However…

Reinforcement Learning