paper-with-me

홈 › Papers

Constructive Alignment: Governing Preference Dynamics in Human-AI Interaction

2026-04-01 · Max Kanwal, Caryn Tran arxiv

Most approaches to AI alignment treat human preferences as fixed targets to be inferred and optimized. This assumption conflicts with extensive empirical evidence showing that preferences are layered, dynamic, and constructed through interaction--particularly with adaptive technologies. As AI systems become more persistent, personalized, and socially embedded, they increasingly participate in shaping what people attend to, value, and endorse over time. We introduce Constructive Alignment, a paradigm that reframes alignment as a control problem over evolving human preference trajectories rather than static preference satisfaction. Drawing on behavioral economics, psychology, and constructivist social theory, we model preferences as layered state variables that evolve under interaction with AI systems. We formalize this view using a control-theoretic framework in which system actions and interaction design jointly influence both world states and human evaluative states. We argue that alignment is not primarily about controlling AI behavior, but about regulating how AI systems influence the evolution of human preferences--ensuring that value trajectories remain coherent, reflectively endorsed, epistemically grounded, bounded against manipulation, and empowering under uncertainty. Alignment thus becomes a problem of governing long-term value formation rather than simply satisfying static preferences.

📄 PDF Abstract BibTeX arXiv:2607.00001

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Human Preferences for Constructive Interactions in Language Model Alignment

2025-03-05 · Yara Kyrychenko, Jon Roozenbeek, Brandon Davidson, Sander van der Linden 외

As large language models (LLMs) enter the mainstream, aligning them to foster constructive dialogue rather than exacerbate societal divisions is critical. Using an individualized and multicultural alignment dataset of ov…

Language ModelingLanguage Modelling

Constructive Large Language Models Alignment with Diverse Feedback

2023-10-10 · Tianshu Yu, Ting-En Lin, Yuchuan Wu, Min Yang 외

In recent research on large language models (LLMs), there has been a growing emphasis on aligning these models with human values to reduce the impact of harmful content. However, current alignment methods often rely sole…

Learning TheoryModels AlignmentQuestion AnsweringText Summarization

Mechanistic Analysis of Alignment Algorithms in Language Models

2026-05-09 · Aarush Sinha, Ishan Garg, Veeraraju Elluru, Arth Singh 외 arxiv

Post-training alignment algorithms are predominantly evaluated as black boxes, obscuring how they reshape language models' internal computations. We present a systematic mechanistic analysis of six preference-optimizatio…

Beyond Preferences: Learning Alignment Principles Grounded in Human Reasons and Values

2026-01-26 · Henry Bell, Lara Neubauer da Costa Schertel, Bochu Ding, Brandon Fain arxiv

A crucial consideration when developing and deploying Large Language Models (LLMs) is the human values to which these models are aligned. In the constitutional framework of alignment models are aligned to a set of princi…

Northeastern Uni at Multilingual Counterspeech Generation: Enhancing Counter Speech Generation with LLM Alignment through Direct Preference Optimization

2024-12-19 · Sahil Wadhwa, Chengtian Xu, Haoming Chen, Aakash Mahalingam 외

The automatic generation of counter-speech (CS) is a critical strategy for addressing hate speech by providing constructive and informed responses. However, existing methods often fail to generate high-quality, impactful…