paper-with-me

Papers

Learning to Communicate Functional States with Nonverbal Expressions for Improved Human-Robot Collaboration

2024-04-30 · Liam Roy, Dana Kulic, Elizabeth Croft

Collaborative robots must effectively communicate their internal state to humans to enable a smooth interaction. Nonverbal communication is widely used to communicate information during human-robot interaction, however, such methods may also be misunderstood, leading to communication errors. In this work, we explore modulating the acoustic parameter values (pitch bend, beats per minute, beats per loop) of nonverbal auditory expressions to convey functional robot states (accomplished, progressing, stuck). We propose a reinforcement learning (RL) algorithm based on noisy human feedback to produce accurately interpreted nonverbal auditory expressions. The proposed approach was evaluated through a user study with 24 participants. The results demonstrate that: 1. Our proposed RL-based approach is able to learn suitable acoustic parameter values which improve the users' ability to correctly identify the state of the robot. 2. Algorithm initialization informed by previous user data can be used to significantly speed up the learning process. 3. The method used for algorithm initialization strongly influences whether participants converge to similar sounds for each robot state. 4. Modulation of pitch bend has the largest influence on user association between sounds and robotic states.

📄 PDF Abstract BibTeX arXiv:2404.19253

Code (1)

liamreneroy/rl_audio 공식 구현

Tasks

Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Strategic Control of Facial Expressions by the Fed Chair

2024-10-26 · Hunter Ng

This article investigates whether the Federal Reserve Chair strategically controls facial expressions during FOMC press conferences and how these nonverbal cues affect financial markets. I use facial recognition technolo…

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

2018-11-23 · Yansen Wang, Ying Shen, Zhun Liu, Paul Pu Liang 외

Humans convey their intentions through the usage of both verbal and nonverbal behaviors during face-to-face communication. Speaker intentions often vary dynamically depending on different nonverbal contexts, such as voca…

Emotion RecognitionMultimodal Sentiment AnalysisSentiment Analysis

Mind the Motions: Benchmarking Theory-of-Mind in Everyday Body Language

2025-11-19 · Seungbeen Lee, Jinhong Jeong, Donghyun Kim, Yejin Son 외 arxiv

Our ability to interpret others' mental states through nonverbal cues (NVCs) is fundamental to our survival and social cohesion. While existing Theory of Mind (ToM) benchmarks have primarily focused on false-belief tasks…

A cognitive neural architecture able to learn and communicate through natural language

2015-06-10 · Bruno Golosio, Angelo Cangelosi, Olesya Gamotina, Giovanni Luca Masala

Communicative interactions involve a kind of procedural knowledge that is used by the human brain for processing verbal and nonverbal inputs and for language production. Although considerable work has been done on modeli…

Incremental Learning

Emotion Recognition for Challenged People Facial Appearance in Social using Neural Network

2023-05-11 · P. Deivendran, P. Suresh Babu, G. Malathi, K. Anbazhagan 외

Human communication is the vocal and non verbal signal to communicate with others. Human expression is a significant biometric object in picture and record databases of surveillance systems. Face appreciation has a serio…

Emotion Recognition