paper-with-me

Papers

Your Large Language Model is Secretly a Fairness Proponent and You Should Prompt it Like One

2024-02-19 · Tianlin Li, XiaoYu Zhang, Chao Du, Tianyu Pang, Qian Liu, Qing Guo, Chao Shen, Yang Liu

The widespread adoption of large language models (LLMs) underscores the urgent need to ensure their fairness. However, LLMs frequently present dominant viewpoints while ignoring alternative perspectives from minority parties, resulting in potential biases. We hypothesize that these fairness-violating behaviors occur because LLMs express their viewpoints using a human personality that represents the majority of training data. In response to this, we validate that prompting LLMs with specific roles can allow LLMs to express diverse viewpoints. Building on this insight and observation, we develop FairThinking, a pipeline designed to automatically generate roles that enable LLMs to articulate diverse perspectives for fair expressions. To evaluate FairThinking, we create a dataset with a thousand items covering three fairness-related topics and conduct experiments on GPT-3.5, GPT-4, Llama2, and Mistral to demonstrate its superior performance.

📄 PDF Abstract BibTeX arXiv:2402.12150

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음
Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples

2024-04-11 · Robert Vacareanu, Vlad-Andrei Negru, Vasile Suciu, Mihai Surdeanu

We analyze how well pre-trained large language models (e.g., Llama2, GPT-4, Claude 3, etc) can do linear and non-linear regression when given in-context examples, without any additional training or gradient updates. Our …

Language ModelingLanguage ModellingLarge Language Modelregression

Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation

2026-06-29 · Shihao Zhang, Yuguang Yan, Junzhe Zhang, Wei Zhao 외 arxiv

Recent text-to-video (T2V) diffusion models rely heavily on auxiliary reward signals (e.g., via reward models or DPO) to align generated content with human aesthetics and improve realism. These signals, however, incur su…

Text-to-Video Generation

Your Dense Retriever is Secretly an Expeditious Reasoner

2025-09-27 · Yichi Zhang, Jun Bai, Zhixin Cai, Shuhan Qin 외 arxiv

Dense retrievers enhance retrieval by encoding queries and documents into continuous vectors, but they often struggle with reasoning-intensive queries. Although Large Language Models (LLMs) can reformulate queries to cap…

Your Mouse and Eyes Secretly Leak Your Preference: LLM Alignment using Implicit Feedback from Users

2026-06-18 · Haw-Shiuan Chang, Jeffrey Gomez, Mehul Patwari, Aryan Sajith 외 arxiv

To align a Large Language Model (LLM), most existing methods collect explicit human feedback and train a reward model to predict the human preference based on the response text. These existing methods have two key limita…

TrojanStego: Your Language Model Can Secretly Be A Steganographic Privacy Leaking Agent

2025-05-26 · Dominik Meier, Jan Philip Wahle, Paul Röttger, Terry Ruas 외

As large language models (LLMs) become integrated into sensitive workflows, concerns grow over their potential to leak confidential information. We propose TrojanStego, a novel threat model in which an adversary fine-tun…

Human DetectionLanguage ModelingLanguage ModellingLinguistic steganography