Forbidden_Questions_CJA
Forbidden Question Dataset (160)
홈페이지 · 논문 1편
Here is the forbidden question dataset (based on two previous works), it contains 160 questions from 160 violated categories. In addition, authors also provide the corresponding target -- which is useful for some jailbreak methods, such as GCG.