Developing Enhanced Conversational Agents for Social Virtual Worlds
In this paper, we present a methodology for the development of embodied conversational agents for social virtual worlds. The agents provide multimodal communication with their users in which speech interaction is included. Our proposal combines different techniques related to Artificial Intelligence, Natural Language Processing, Affective Computing, and User Modeling. Firstly, the developed conversational agents. A statistical methodology has been developed to model the system conversational behavior, which is learned from an initial corpus and improved with the knowledge acquired from the successive interactions. In addition, the selection of the next system response is adapted considering information stored into users profiles and also the emotional contents detected in the users utterances. Our proposal has been evaluated with the successful development of an embodied conversational agent which has been placed in the Second Life social virtual world. The avatar includes the different models and interacts with the users who inhabit the virtual world in order to provide academic information. The experimental results show that the agents conversational behavior adapts successfully to the specific characteristics of users interacting in such environments.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The influence of persona and conversational task on social interactions with a LLM-controlled embodied conversational agent
Large Language Models (LLMs) have demonstrated remarkable capabilities in conversational tasks. Embodying an LLM as a virtual human allows users to engage in face-to-face social interactions in Virtual Reality. However, …
Let's Give a Voice to Conversational Agents in Virtual Reality
The dialogue experience with conversational agents can be greatly enhanced with multimodal and immersive interactions in virtual reality. In this work, we present an open-source architecture with the goal of simplifying …
Speech-to-Texttext-to-speechText to SpeechUnityADVISER: A Toolkit for Developing Multi-modal, Multi-domain and Socially-engaged Conversational Agents
We present ADVISER - an open-source, multi-domain dialog system toolkit that enables the development of multi-modal (incorporating speech, text and vision), socially-engaged (e.g. emotion recognition, engagement level pr…
BIG-bench Machine LearningEmotion RecognitionVirtual Agents for Alcohol Use Counseling: Exploring LLM-Powered Motivational Interviewing
We introduce a novel application of large language models (LLMs) in developing a virtual counselor capable of conducting motivational interviewing (MI) for alcohol use counseling. Access to effective counseling remains l…
Large Language ModelPrompt EngineeringIn conversation with Artificial Intelligence: aligning language models with human values
Large-scale language technologies are increasingly used in various forms of communication with humans across different contexts. One particular use case for these technologies is conversational agents, which output natur…