paper-with-me

홈 › Papers

SafeMed-R1: Clinician-Audited Safety and Ethics Alignment for Medical Large Language Models

2026-05-27 · Chao Ding, Mouxiao Bian, Tianbin Li, Minjia Yuan, Yidong Jiang, Yankai Jiang, Jinru Ding, Jiayuan Chen, Zhuangzhi Gao, Pengcheng Chen, Zhao He, Rongzhao Zhang, Meiling Liu, Luyi Jiang, Jie Xu arxiv

Large language models(LLMs) increasingly match expert performance on licensing examinations, yet routine clinical use remains limited because governance requires auditable reasoning, safety and ethics alignment, and resilience to adversarial misuse. Here we present SafeMed-R1, trained with a traceable Clinical Trust Signals(CTS) pipeline that links each reasoning instance to clinician rubric scores and edit histories, and aligned through safety and ethics supervision and red team stress testing. SafeMed-R1 attains a macro-averaged accuracy of 79.6% across clinical benchmarks. Under adversarial safety testing, it shows the lowest aggregated risk and reduces unsafe outputs by about 3 to 5% relative to its baseline. In a paired expert study of 30 medication safety vignettes, SafeMed-R1 matches PGY1 and PGY2 residents on medical correctness and scores higher for medication safety, guideline consistency, and clinical usefulness. Collectively, these results suggest that clinician-audited supervision provenance, together with domain-tailored safety and ethics alignment, can strengthen governance-relevant evidence without relying on inference-time retrieval or citation grounding.

📄 PDF Abstract BibTeX arXiv:2605.28338

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mind the Gap! Pathways Towards Unifying AI Safety and Ethics Research

2025-12-10 · Dani Roytburg, Beck Miller arxiv

While much research in artificial intelligence (AI) has focused on scaling capabilities, the accelerating pace of development makes countervailing work on producing harmless, "aligned" systems increasingly urgent. Yet re…

SafeMed-R1: Adversarial Reinforcement Learning for Generalizable and Robust Medical Reasoning in Vision-Language Models

2025-12-22 · A. A. Gde Yogi Pramana, Jason Ray, Anthony Jaya, Michael Wijaya arxiv

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversar…

Visual Question AnsweringReinforcement LearningAdversarial Robustness

PsychEthicsBench: Evaluating Large Language Models Against Australian Mental Health Ethics

2026-01-07 · Yaling Shen, Stephanie Fong, Yiwen Jiang, Zimu Wang 외 arxiv

The increasing integration of large language models (LLMs) into mental health applications necessitates robust frameworks for evaluating professional safety alignment. Current evaluative approaches primarily rely on refu…

Safety without alignment

2023-02-27 · András Kornai, Michael Bukatin, Zsolt Zombori

Currently, the dominant paradigm in AI safety is alignment with human values. Here we describe progress on developing an alternative approach to safety, based on ethical rationalism (Gewirth:1978), and propose an inheren…

Ethics

ProMoral-Bench: Evaluating Prompting Strategies for Moral Reasoning and Safety in LLMs

2026-02-05 · Rohan Subramanian Thomas, Shikhar Shiromani, Abdullah Chaudhry, Ruizhe Li 외 arxiv

Prompt design significantly impacts the moral competence and safety alignment of large language models (LLMs), yet empirical comparisons remain fragmented across datasets and models.We introduce ProMoral-Bench, a unified…

Prompt Engineering