paper-with-me

홈 › Papers

Prosody as a Teaching Signal for Agent Learning: Exploratory Studies and Algorithmic Implications

2024-10-31 · Matilda Knierim, Sahil Jain, Murat Han Aydoğan, Kenneth Mitra, Kush Desai, Akanksha Saran, Kim Baraka

Agent learning from human interaction often relies on explicit signals, but implicit social cues, such as prosody in speech, could provide valuable information for more effective learning. This paper advocates for the integration of prosody as a teaching signal to enhance agent learning from human teachers. Through two exploratory studies--one examining voice feedback in an interactive reinforcement learning setup and the other analyzing restricted audio from human demonstrations in three Atari games--we demonstrate that prosody carries significant information about task dynamics. Our findings suggest that prosodic features, when coupled with explicit feedback, can enhance reinforcement learning outcomes. Moreover, we propose guidelines for prosody-sensitive algorithm design and discuss insights into teaching behavior. Our work underscores the potential of leveraging prosody as an implicit signal for more efficient agent learning, thus advancing human-agent interaction paradigms.

📄 PDF Abstract BibTeX arXiv:2410.23554

Code (1)

sahiljain11/audio_rl 공식 구현

Tasks

Atari Gamesreinforcement-learningReinforcement Learning

Similar Papers 제목 키워드 기반

How Much Progress Did I Make? An Unexplored Human Feedback Signal for Teaching Robots

2024-07-08 · Hang Yu, Qidi Fang, Shijie Fang, Reuben M. Aronson 외

Enhancing the expressiveness of human teaching is vital for both improving robots' learning from humans and the human-teaching-robot experience. In this work, we characterize and test a little-used teaching signal: \text…

Teaching is a Process: The TOSS Framework for Modeling Human Teaching Decisions in Human-Interactive Robot Learning

2026-08-21 · Bernhard Hilpert, Kim Baraka, Joost Broekens arxiv

Successful Human-Robot Teaching assumes alignment between robot processing needs and human teaching intent. To better understand this alignment, this work seeks to uncover the underlying logic that humans intuitively app…

Reinforcement Learning

Natural Language Communication with a Teachable Agent

2022-03-17 · Rachel Love, Edith Law, Philip R. Cohen, Dana Kulić

Conversational teachable agents offer a promising platform to support learning, both in the classroom and in remote settings. In this context, the agent takes the role of the novice, while the student takes on the role o…

Spectrum and Prosody Conversion for Cross-lingual Voice Conversion with CycleGAN

2020-08-11 · Zongyang Du, Kun Zhou, Berrak Sisman, Haizhou Li

Cross-lingual voice conversion aims to change source speaker's voice to sound like that of target speaker, when source and target speakers speak different languages. It relies on non-parallel training data from two diffe…

Voice Conversion

Fine-grained robust prosody transfer for single-speaker neural text-to-speech

2019-07-04 · Viacheslav Klimkov, Srikanth Ronanki, Jonas Rohnke, Thomas Drugman

We present a neural text-to-speech system for fine-grained prosody transfer from one speaker to another. Conventional approaches for end-to-end prosody transfer typically use either fixed-dimensional or variable-length p…

text-to-speechText to Speech