paper-with-me

Papers

Collaborative AI Teaming in Unknown Environments via Active Goal Deduction

2024-03-22 · Zuyuan Zhang, Hanhan Zhou, Mahdi Imani, Taeyoung Lee, Tian Lan

With the advancements of artificial intelligence (AI), we're seeing more scenarios that require AI to work closely with other agents, whose goals and strategies might not be known beforehand. However, existing approaches for training collaborative agents often require defined and known reward signals and cannot address the problem of teaming with unknown agents that often have latent objectives/rewards. In response to this challenge, we propose teaming with unknown agents framework, which leverages kernel density Bayesian inverse learning method for active goal deduction and utilizes pre-trained, goal-conditioned policies to enable zero-shot policy adaptation. We prove that unbiased reward estimates in our framework are sufficient for optimal teaming with unknown agents. We further evaluate the framework of redesigned multi-agent particle and StarCraft II micromanagement environments with diverse unknown agents of different behaviors/rewards. Empirical results demonstrate that our framework significantly advances the teaming performance of AI and unknown agents in a wide range of collaborative scenarios.

📄 PDF Abstract BibTeX arXiv:2403.15341

Code (0)

등록된 구현이 없습니다.

Tasks

StarcraftStarcraft II

Similar Papers 제목 키워드 기반

Unraveling Human-AI Teaming: A Review and Outlook

2025-04-08 · Bowen Lou, Tian Lu, T. S. Raghu, Yingjie Zhang

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeve…

Decision Making

DecodingTrust-Agent Platform (DTap): A Controllable and Interactive Red-Teaming Platform for AI Agents

2026-05-06 · Zhaorun Chen, Xun Liu, Haibo Tong, Chengquan Guo 외 arxiv

AI agents are increasingly deployed across diverse domains to automate complex workflows through long-horizon and high-stakes action executions. Due to their high capability and flexibility, such agents raise significant…

BodyGuards: Escorting by Multiple Robots in Unknown Environment under Limited Communication

2026-03-16 · Zhuoli Tian, Yanze Bao, Meng Guo arxiv

Multi-robot systems are increasingly deployed in high-risk missions such as reconnaissance, disaster response, and subterranean operations. Protecting a human operator while navigating unknown and adversarial environment…

GPT-Red: Automated Red Teaming via Self-Play at Scale

2026-07-28 · Eric Wallace, Christopher A. Choquette-Choo, Nikhil Kandpal, Sam Toyer 외 hf

We introduce GPT-Red, an automated red-teaming agent that is trained to discover novel prompt injection attacks against frontier LLMs. The goal of this model is to evaluate and improve the robustness of our production sy…

Red Teaming

Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021

2022-05-05 · Julia Kiseleva, Ziming Li, Mohammad Aliannejadi, Shrestha Mohanty 외

Human intelligence has the remarkable ability to quickly adapt to new tasks and environments. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of…