paper-with-me

홈 › Papers

Intentional Biases in LLM Responses

2023-11-11 · Nicklaus Badyal, Derek Jacoby, Yvonne Coady

In this study we intentionally introduce biases into large language model responses in an attempt to create specific personas for interactive media purposes. We explore the differences between open source models such as Falcon-7b and the GPT-4 model from Open AI, and we quantify some differences in responses afforded by the two systems. We find that the guardrails in the GPT-4 mixture of experts models with a supervisor, while useful in assuring AI alignment in general, are detrimental in trying to construct personas with a variety of uncommon viewpoints. This study aims to set the groundwork for future exploration in intentional biases of large language models such that these practices can be applied in the creative field, and new forms of media.

📄 PDF Abstract BibTeX arXiv:2311.07611

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language ModelMixture-of-Experts

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Stereotype or Personalization? User Identity Biases Chatbot Recommendations

2024-10-08 · Anjali Kantharuban, Jeremiah Milbauer, Emma Strubell, Graham Neubig

We demonstrate that when people use large language models (LLMs) to generate recommendations, the LLMs produce responses that reflect both what the user wants and who the user is. While personalized recommendations are o…

Chatbot

Leveraging Self-Supervised Training for Unintentional Action Recognition

2022-09-23 · Enea Duka, Anna Kukleva, Bernt Schiele

Unintentional actions are rare occurrences that are difficult to define precisely and that are highly dependent on the temporal context of the action. In this work, we explore such actions and seek to identify the points…

Action Recognition

VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Models

2025-03-10 · Jen-tse Huang, Jiantong Qin, Jianping Zhang, Youliang Yuan 외

This research investigates both explicit and implicit social biases exhibited by Vision-Language Models (VLMs). The key distinction between these bias types lies in the level of awareness: explicit bias refers to conscio…

Image DescriptionMultiple-choice

Self-Blinding and Counterfactual Self-Simulation Mitigate Biases and Sycophancy in Large Language Models

2026-01-21 · Brian Christian, Matan Mazor arxiv

Fair decisions require ignoring irrelevant, potentially biasing, information. To achieve this, decision-makers need to approximate what decision they would have made had they not known certain facts, such as the gender o…

Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization

2024-10-11 · Noam Razin, Sadhika Malladi, Adithya Bhaskar, Danqi Chen 외

Direct Preference Optimization (DPO) and its variants are increasingly used for aligning language models with human preferences. Although these methods are designed to teach a model to generate preferred responses more f…