paper-with-me

홈 › Papers

Leveraging Large Language Models in Human-Robot Interaction: A Critical Analysis of Potential and Pitfalls

2024-03-26 · Jesse Atuhurra

The emergence of large language models (LLM) and, consequently, vision language models (VLM) has ignited new imaginations among robotics researchers. At this point, the range of applications to which LLM and VLM can be applied in human-robot interaction (HRI), particularly socially assistive robots (SARs), is unchartered territory. However, LLM and VLM present unprecedented opportunities and challenges for SAR integration. We aim to illuminate the opportunities and challenges when roboticists deploy LLM and VLM in SARs. First, we conducted a meta-study of more than 250 papers exploring 1) major robots in HRI research and 2) significant applications of SARs, emphasizing education, healthcare, and entertainment while addressing 3) societal norms and issues like trust, bias, and ethics that the robot developers must address. Then, we identified 4) critical components of a robot that LLM or VLM can replace while addressing the 5) benefits of integrating LLM into robot designs and the 6) risks involved. Finally, we outline a pathway for the responsible and effective adoption of LLM or VLM into SARs, and we close our discussion by offering caution regarding this deployment.

📄 PDF Abstract BibTeX arXiv:2405.00693

Code (0)

등록된 구현이 없습니다.

Tasks

Ethics

Similar Papers 제목 키워드 기반

A Sign Language Recognition System with Pepper, Lightweight-Transformer, and LLM

2023-09-28 · JongYoon Lim, Inkyu Sa, Bruce MacDonald, Ho Seok Ahn

This research explores using lightweight deep neural network architectures to enable the humanoid robot Pepper to understand American Sign Language (ASL) and facilitate non-verbal human-robot interaction. First, we intro…

Prompt EngineeringSign Language Recognition

Effect of Adaptive Communication Support on LLM-powered Human-Robot Collaboration

2024-11-26 · Shipeng Liu, FNU Shrutika, Boshen Zhang, Zhehui Huang 외

Effective human-robot collaboration requires robot to adopt their roles and levels of support based on human needs, task requirements, and complexity. Traditional human-robot teaming often relies on a pre-determined robo…

Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory

2024-05-30 · Hangyeol Kang, Maher Ben Moussa, Nadia Magnenat-Thalmann

In this work, we describe our approach to developing an intelligent and robust social robotic system for the Nadine social robot platform. We achieve this by integrating Large Language Models (LLMs) and skilfully leverag…

Instruction Following

Generative Simulation for Policy Learning in Physical Human-Robot Interaction

2026-04-09 · Junxiang Wang, Xinwen Xu, Tiancheng Wu, Julian Millan 외 arxiv

Developing autonomous physical human-robot interaction (pHRI) systems is limited by the scarcity of large-scale training data to learn robust robot behaviors for real-world applications. In this paper, we introduce a zer…

Point Clouds

Humanizing Robot Gaze Shifts: A Framework for Natural Gaze Shifts in Humanoid Robots

2026-02-25 · Jingchao Wei, Jingkai Qin, Yuxiao Cao, Jingcheng Huang 외 arxiv

Leveraging auditory and visual feedback for attention reorientation is essential for natural gaze shifts in social interaction. However, enabling humanoid robots to perform natural and context-appropriate gaze shifts in …