paper-with-me

SUDOER

System/User Dataset for Obedience Evaluation in Responses

홈페이지 · 논문 1편

The dataset aims to provide system prompts and user prompts for assistant. You should make random pairs and compute human preference for both system prompt obedience and user prompt relevance through A/B testing.

Texts English