paper-with-me

홈 › Papers

FlipGuard: Defending Preference Alignment against Update Regression with Constrained Optimization

2024-10-01 · Mingye Zhu, Yi Liu, Quan Wang, Junbo Guo, Zhendong Mao

Recent breakthroughs in preference alignment have significantly improved Large Language Models' ability to generate texts that align with human preferences and values. However, current alignment metrics typically emphasize the post-hoc overall improvement, while overlooking a critical aspect: regression, which refers to the backsliding on previously correctly-handled data after updates. This potential pitfall may arise from excessive fine-tuning on already well-aligned data, which subsequently leads to over-alignment and degeneration. To address this challenge, we propose FlipGuard, a constrained optimization approach to detect and mitigate update regression with focal attention. Specifically, FlipGuard identifies performance degradation using a customized reward characterization and strategically enforces a constraint to encourage conditional congruence with the pre-aligned model during training. Comprehensive experiments demonstrate that FlipGuard effectively alleviates update regression while demonstrating excellent overall performance, with the added benefit of knowledge preservation while aligning preferences.

📄 PDF Abstract BibTeX arXiv:2410.00508

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

FlipGuard: Defending Large Language Models Against Quantization-Conditioned Backdoor Attacks

2026-06-27 · Aoying Zheng, Anqi Du, Zizhuang Deng, Yuxuan Chen arxiv

Model quantization is essential for the efficient deployment of Large Language Models (LLMs), but introduces a critical vulnerability: Quantization-Conditioned Backdoor (QCB) attacks. In these attacks, malicious behavior…

Code Generation

Defending Against Backdoor Attacks via Alignment Checking in Model-Contrastive Federated Learning

2026-07-29 · Hongliang Zhang, Zhongyuan Yu, Guijuan Wang, Tianqing He 외 arxiv

Federated Learning (FL) is vulnerable to backdoor attacks because of its distributed nature in edge computing scenarios. Existing defense methods show limited efficacy as they overlook the deviations among benign local u…

Federated Learning

Towards NSFW-Free Text-to-Image Generation via Safety-Constraint Direct Preference Optimization

2025-04-19 · Shouwei Ruan, Zhenyu Wu, Yao Huang, Ruochen Zhang 외

Ensuring the safety of generated content remains a fundamental challenge for Text-to-Image (T2I) generation. Existing studies either fail to guarantee complete safety under potentially harmful concepts or struggle to bal…

Contrastive LearningImage GenerationSafety AlignmentText to Image Generation+1

Defending Against Alignment-Breaking Attacks via Robustly Aligned LLM

2023-09-18 · Bochuan Cao, Yuanpu Cao, Lu Lin, Jinghui Chen

Recently, Large Language Models (LLMs) have made significant advancements and are now widely used across various domains. Unfortunately, there has been a rising concern that LLMs can be misused to generate harmful or mal…

Semantic Shield: Defending Vision-Language Models Against Backdooring and Poisoning via Fine-grained Knowledge Alignment

2024-11-23 · CVPR 2024 1 · Alvi Md Ishmam, Christopher Thomas

In recent years there has been enormous interest in vision-language models trained using self-supervised objectives. However, the use of large-scale datasets scraped from the web for training also makes these models vuln…

Language ModelingLanguage Modelling