paper-with-me

홈 › Papers

Uncovering Constraint-Based Behavior in Neural Models via Targeted Fine-Tuning

2021-06-02 · ACL 2021 5 · Forrest Davis, Marten Van Schijndel

A growing body of literature has focused on detailing the linguistic knowledge embedded in large, pretrained language models. Existing work has shown that non-linguistic biases in models can drive model behavior away from linguistic generalizations. We hypothesized that competing linguistic processes within a language, rather than just non-linguistic model biases, could obscure underlying linguistic knowledge. We tested this claim by exploring a single phenomenon in four languages: English, Chinese, Spanish, and Italian. While human behavior has been found to be similar across languages, we find cross-linguistic variation in model behavior. We show that competing processes in a language act as constraints on model behavior and demonstrate that targeted fine-tuning can re-weight the learned constraints, uncovering otherwise dormant linguistic knowledge in models. Our results suggest that models need to learn both the linguistic constraints in a language and their relative ranking, with mismatches in either producing non-human-like behavior.

📄 PDF Abstract BibTeX arXiv:2106.01207

Code (1)

forrestdavis/ImplicitCausality 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations

2025-05-16 · Jian-Qiao Zhu, Haijiang Yan, Thomas L. Griffiths

Changing the behavior of large language models (LLMs) can be as straightforward as editing the Transformer's residual streams using appropriately constructed "steering vectors." These modifications to internal neural act…

NanoFlux: Adversarial Dual-LLM Evaluation and Distillation For Multi-Domain Reasoning

2025-09-27 · Raviteja Anantha, Soheil Hor, Teodor Nicola Antoniu, Layne C. Price arxiv

We present NanoFlux, a novel adversarial framework for generating targeted training data to improve LLM reasoning, where adversarially-generated datasets containing fewer than 200 examples outperform conventional fine-tu…

Mathematical Reasoning

Interactive Evaluation of Large Language Models for Multi-Requirement Software Engineering Tasks

2025-08-26 · Dimitrios Rontogiannis, Maxime Peyrard, Nicolas Baldwin, Martin Josifoski 외 arxiv

Standard single-turn, static benchmarks fall short in evaluating the nuanced capabilities of Large Language Models (LLMs) on complex tasks such as software engineering. In this work, we propose a novel interactive evalua…

BLOCK-EM: Preventing Emergent Misalignment via Latent Blocking

2026-01-31 · Muhammed Ustaomeroglu, Guannan Qu arxiv

Emergent misalignment can arise when a language model is fine-tuned on a narrowly scoped supervised objective: the model learns the target behavior, yet also develops undesirable out-of-domain behaviors. We investigate a…

Preventing Safety Drift in Large Language Models via Coupled Weight and Activation Constraints

2026-04-14 · Songping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang 외 arxiv

Safety alignment in Large Language Models (LLMs) remains highly fragile during fine-tuning, where even benign adaptation can degrade pre-trained refusal behaviors and enable harmful responses. Existing defenses typically…