paper-with-me

Papers

Aligning Language Models with Demonstrated Feedback

2024-06-02 · Omar Shaikh, Michelle S. Lam, Joey Hejna, Yijia Shao, Hyundong Cho, Michael S. Bernstein, Diyi Yang

Language models are aligned to emulate the collective voice of many, resulting in outputs that align with no one in particular. Steering LLMs away from generic output is possible through supervised finetuning or RLHF, but requires prohibitively large datasets for new ad-hoc tasks. We argue that it is instead possible to align an LLM to a specific setting by leveraging a very small number (< 10) of demonstrations as feedback. Our method, Demonstration ITerated Task Optimization (DITTO), directly aligns language model outputs to a user's demonstrated behaviors. Derived using ideas from online imitation learning, DITTO cheaply generates online comparison data by treating users' demonstrations as preferred over output from the LLM and its intermediate checkpoints. Concretely, DITTO operates by having an LLM generate examples that are presumed to be inferior to expert demonstrations. The method iteratively constructs pairwise preference relationships between these LLM-generated samples and expert demonstrations, potentially including comparisons between different training checkpoints. These constructed preference pairs are then used to train the model using a preference optimization algorithm (e.g. DPO). We evaluate DITTO's ability to learn fine-grained style and task alignment across domains such as news articles, emails, and blog posts. Additionally, we conduct a user study soliciting a range of demonstrations from participants (N = 16). Across our benchmarks and user study, we find that win-rates for DITTO outperform few-shot prompting, supervised fine-tuning, and other self-play methods by an avg. of 19% points. By using demonstrations as feedback directly, DITTO offers a novel method for effective customization of LLMs.

📄 PDF Abstract BibTeX arXiv:2406.00888

Code (1)

SALT-NLP/demonstrated-feedback 공식 구현 pytorch

Tasks

ArticlesAvgImitation LearningLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

FGAIF: Aligning Large Vision-Language Models with Fine-grained AI Feedback

2024-04-07 · Liqiang Jing, Xinya Du

Large Vision-Language Models (LVLMs) have demonstrated proficiency in tackling a variety of visual-language tasks. However, current LVLMs suffer from misalignment between text and image modalities which causes three kind…

AttributeHallucinationReinforcement Learning (RL)

Sequence to Sequence Reward Modeling: Improving RLHF by Language Feedback

2024-08-30 · Jiayi Zhou, Jiaming Ji, Juntao Dai, Yaodong Yang

Aligning the behavior of Large language models (LLMs) with human intentions and values remains a critical challenge. Reinforcement learning from human feedback (RLHF) aligns LLMs by training a reward model (RM) on human …

Text Summarization

A Critical Evaluation of AI Feedback for Aligning Large Language Models

2024-02-19 · Archit Sharma, Sedrick Keh, Eric Mitchell, Chelsea Finn 외

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using dem…

Instruction Followingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback

2024-08-28 · Taiwei Shi, Zhuoer Wang, Longqi Yang, Ying-Chun Lin 외

As large language models (LLMs) continue to advance, aligning these models with human preferences has emerged as a critical challenge. Traditional alignment methods, relying on human or LLM annotated datasets, are limite…

Students' Perceptions and Preferences of Generative Artificial Intelligence Feedback for Programming

2023-12-17 · Zhengdong Zhang, Zihan Dong, Yang Shi, Noboru Matsuda 외

The rapid evolution of artificial intelligence (AI), specifically large language models (LLMs), has opened opportunities for various educational applications. This paper explored the feasibility of utilizing ChatGPT, one…

Specificity