paper-with-me

홈 › Papers

DoubleAgents: Human-Agent Alignment in a Socially Embedded Workflow

2025-09-16 · Tao Long, Xuanming Zhang, Sitong Wang, Zhou Yu, Lydia B Chilton arxiv

Aligning agentic AI with user intent is critical for delegating complex, socially embedded tasks, yet user preferences are often implicit, evolving, and difficult to specify upfront. We present DoubleAgents, a system for human-agent alignment in coordination tasks, grounded in distributed cognition. DoubleAgents integrates three components: (1) a coordination agent that maintains state and proposes plans and actions, (2) a dashboard visualization that makes the agent's reasoning legible for user evaluation, and (3) a policy module that transforms user edits into reusable alignment artifacts, including coordination policies, email templates, and stop hooks, which improve system behavior over time. We evaluate DoubleAgents through a two-day lab study (n=10), three real-world deployments, and a technical evaluation. Participants' comfort in offloading tasks and reliance on DoubleAgents both increased over time, correlating with the three distributed cognition components. Participants still required control at points of uncertainty - edge-case flagging and context-dependent actions. We contribute a distributed cognition approach to human-agent alignment in socially embedded tasks.

📄 PDF Abstract BibTeX arXiv:2509.12626

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Cards Against LLMs: Benchmarking Humor Alignment in Large Language Models

2026-04-09 · Yousra Fettach, Guillaume Bied, Hannu Toivonen, Tijl De Bie arxiv

Humor is one of the most culturally embedded and socially significant dimensions of human communication, yet it remains largely unexplored as a dimension of Large Language Model (LLM) alignment. In this study, five front…

Evaluating Behavioral Alignment in Conflict Dialogue: A Multi-Dimensional Comparison of LLM Agents and Humans

2025-09-19 · Deuksin Kwon, Kaleen Shrestha, Bin Han, Elena Hayoung Lee 외 arxiv

Large Language Models (LLMs) are increasingly deployed in socially complex, interaction-driven tasks, yet their ability to mirror human behavior in emotionally and strategically complex contexts remains underexplored. Th…

TRAIL: A Platform for Configurable Human--AI Teaming Experiments

2026-07-13 · Mohammad Amin Samadi, Pedro Martins De Bastos, Jaeyoon Choi, Spencer JaQuay 외 arxiv

An AI teammate's design properties (personality, communication style, when it speaks) can shape a team's trust, coordination, and decisions. Studying this rigorously demands infrastructure no existing tool provides: repr…

Aligning to Social Norms and Values in Interactive Narratives

2022-05-04 · NAACL 2022 7 · Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hannaneh Hajishirzi 외

We focus on creating agents that act in alignment with socially beneficial norms and values in interactive narratives or text-based games -- environments wherein an agent perceives and interacts with a world through natu…

text-based games

Crossing the Tepper Line: An Emerging Ontology for Describing the Dynamic Sociality of Embodied AI

2021-03-15 · Katie Seaborn, Peter Pennefather, Norihisa P. Miyake, Mihoko Otake-Matsuura

Artificial intelligences (AI) are increasingly being embodied and embedded in the world to carry out tasks and support decision-making with and for people. Robots, recommender systems, voice assistants, virtual humans - …

Decision MakingRecommendation Systems