Detecting Natural Language Biases with Prompt-based Learning
In this project, we want to explore the newly emerging field of prompt engineering and apply it to the downstream task of detecting LM biases. More concretely, we explore how to design prompts that can indicate 4 different types of biases: (1) gender, (2) race, (3) sexual orientation, and (4) religion-based. Within our project, we experiment with different manually crafted prompts that can draw out the subtle biases that may be present in the language model. We apply these prompts to multiple variations of popular and well-recognized models: BERT, RoBERTa, and T5 to evaluate their biases. We provide a comparative analysis of these models and assess them using a two-fold method: use human judgment to decide whether model predictions are biased and utilize model-level judgment (through further prompts) to understand if a model can self-diagnose the biases of its own prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingPrompt EngineeringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark
Detecting biases in natural language understanding (NLU) for African American Vernacular English (AAVE) is crucial to developing inclusive natural language processing (NLP) systems. To address dialect-induced performance…
Language ModelingLanguage ModellingLarge Language ModelNatural Language UnderstandingUsing Natural Sentence Prompts for Understanding Biases in Language Models
Evaluation of biases in language models is often limited to synthetically generated datasets. This dependence traces back to the need of prompt-style dataset to trigger specific behaviors of language models. In this pape…
SentenceUsing Natural Sentence Prompts for Understanding Biases in Language Models
Evaluation of biases in language models is often limited to synthetically generated datasets. This dependence traces back to the need of prompt-style dataset to trigger specific behaviors of language models. In this pape…
SentenceUsing Natural Sentences for Understanding Biases in Language Models
Evaluation of biases in language models is often limited to synthetically generated datasets. This dependence traces back to the need for a prompt-style dataset to trigger specific behaviors of language models. In this p…
SentenceFew-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases
Detecting social bias in text is challenging due to nuance, subjectivity, and difficulty in obtaining good quality labeled datasets at scale, especially given the evolving nature of social biases and society. To address …