paper-with-me

Papers

MIRROR: Differentiable Deep Social Projection for Assistive Human-Robot Communication

2022-03-06 · Kaiqi Chen, Jeffrey Fong, Harold Soh

Communication is a hallmark of intelligence. In this work, we present MIRROR, an approach to (i) quickly learn human models from human demonstrations, and (ii) use the models for subsequent communication planning in assistive shared-control settings. MIRROR is inspired by social projection theory, which hypothesizes that humans use self-models to understand others. Likewise, MIRROR leverages self-models learned using reinforcement learning to bootstrap human modeling. Experiments with simulated humans show that this approach leads to rapid learning and more robust models compared to existing behavioral cloning and state-of-the-art imitation learning methods. We also present a human-subject study using the CARLA simulator which shows that (i) MIRROR is able to scale to complex domains with high-dimensional observations and complicated world physics and (ii) provides effective assistive communication that enabled participants to drive more safely in adverse weather conditions.

📄 PDF Abstract BibTeX arXiv:2203.02877

Code (1)

clear-nus/mirror 공식 구현 pytorch

Tasks

Imitation Learning

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

PovNet+: A Deep Learning Architecture for Socially Assistive Robots to Learn and Assist with Multiple Activities of Daily Living

2026-01-28 · Fraser Robinson, Souren Pashangpour, Matthew Lisondra, Goldie Nejat arxiv

A significant barrier to the long-term deployment of autonomous socially assistive robots is their inability to both perceive and assist with multiple activities of daily living (ADLs). In this paper, we present the firs…

Human Activity RecognitionMultimodal Deep Learning

SocialMind: LLM-based Proactive AR Social Assistive System with Human-like Perception for In-situ Live Interactions

2024-12-05 · Bufang Yang, Yunqi Guo, Lilin Xu, Zhenyu Yan 외

Social interactions are fundamental to human life. The recent emergence of large language models (LLMs)-based virtual assistants has demonstrated their potential to revolutionize human interactions and lifestyles. Howeve…

Human Autonomy as a Design Principle for Socially Assistive Robots

2022-11-12 · Jason R. Wilson

High levels of robot autonomy are a common goal, but there is a significant risk that the greater the autonomy of the robot the lesser the autonomy of the human working with the robot. For vulnerable populations like old…

Social Learning through Interactions with Other Agents: A Survey

2024-07-31 · Dylan Hillier, Cheston Tan, Jing Jiang

Social learning plays an important role in the development of human intelligence. As children, we imitate our parents' speech patterns until we are able to produce sounds; we learn from them praising us and scolding us; …

Behavioural cloningSurvey

Learning to Assist: Physics-Grounded Human-Human Control via Multi-Agent Reinforcement Learning

2026-03-11 · Yuto Shibata, Kashu Yamazaki, Lalit Jayanti, Yoshimitsu Aoki 외 arxiv

Humanoid robotics has strong potential to transform daily service and caregiving applications. Although recent advances in general motion tracking within physics engines (GMT) have enabled virtual characters and humanoid…

Multi-agent Reinforcement Learning