paper-with-me

Papers

MoJE: Mixture of Jailbreak Experts, Naive Tabular Classifiers as Guard for Prompt Attacks

2024-09-26 · Giandomenico Cornacchia, Giulio Zizzo, Kieran Fraser, Muhammad Zaid Hameed, Ambrish Rawat, Mark Purcell

The proliferation of Large Language Models (LLMs) in diverse applications underscores the pressing need for robust security measures to thwart potential jailbreak attacks. These attacks exploit vulnerabilities within LLMs, endanger data integrity and user privacy. Guardrails serve as crucial protective mechanisms against such threats, but existing models often fall short in terms of both detection accuracy, and computational efficiency. This paper advocates for the significance of jailbreak attack prevention on LLMs, and emphasises the role of input guardrails in safeguarding these models. We introduce MoJE (Mixture of Jailbreak Expert), a novel guardrail architecture designed to surpass current limitations in existing state-of-the-art guardrails. By employing simple linguistic statistical techniques, MoJE excels in detecting jailbreak attacks while maintaining minimal computational overhead during model inference. Through rigorous experimentation, MoJE demonstrates superior performance capable of detecting 90% of the attacks without compromising benign prompts, enhancing LLMs security against jailbreak attacks.

📄 PDF Abstract BibTeX arXiv:2409.17699

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models

2026-02-04 · Jiacheng Liang, Yuhui Wang, Tanqiu Jiang, Ting Wang arxiv

Mixture-of-Experts (MoE) language models introduce unique challenges for safety alignment due to their sparse routing mechanisms, which can enable degenerate optimization behaviors under standard full-parameter fine-tuni…

Interpretable Mixture of Experts

2022-06-05 · Aya Abdelsalam Ismail, Sercan Ö. Arik, Jinsung Yoon, Ankur Taly 외

The need for reliable model explanations is prominent for many machine learning applications, particularly for tabular and time-series data as their use cases often involve high-stakes decision making. Towards this goal,…

Decision MakingMixture-of-ExpertsTime Series

RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs

2026-05-01 · Zhiyuan Xu, Joseph Gardiner, Sana Belguith, Lichao Wu arxiv

Safety alignment is critical for the responsible deployment of large language models (LLMs). As Mixture-of-Experts (MoE) architectures are increasingly adopted to scale model capacity, understanding their safety robustne…

Implicit Mixture of Interpretable Experts for Global and Local Interpretability

2022-12-01 · Nathan Elazar, Kerry Taylor

We investigate the feasibility of using mixtures of interpretable experts (MoIE) to build interpretable image classifiers on MNIST10. MoIE uses a black-box router to assign each input to one of many inherently interpreta…

Classification

A Closer Look into LLMs for Table Understanding

2026-03-16 · Jia Wang, Chuanyu Qin, Mingyu Zheng, Qingyi Si 외 arxiv

Despite the success of Large Language Models (LLMs) in table understanding, their internal mechanisms remain unclear. In this paper, we conduct an empirical study on 16 LLMs, covering general LLMs, specialist tabular LLM…