Zara: A Virtual Interactive Dialogue System Incorporating Emotion, Sentiment and Personality Recognition
Zara, or {`}Zara the Supergirl{'} is a virtual robot, that can exhibit empathy while interacting with an user, with the aid of its built in facial and emotion recognition, sentiment analysis, and speech module. At the end of the 5-10 minute conversation, Zara can give a personality analysis of the user based on all the user utterances. We have also implemented a real-time emotion recognition, using a CNN model that detects emotion from raw audio without feature extraction, and have achieved an average of 65.7{\%} accuracy on six different emotion classes, which is an impressive 4.5{\%} improvement from the conventional feature based SVM classification. Also, we have described a CNN based sentiment analysis module trained using out-of-domain data, that recognizes sentiment from the speech recognition transcript, which has a 74.8 F-measure when tested on human-machine dialogues.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionFeature EngineeringSentiment Analysisspeech-recognitionSpeech RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Zara Returns: Improved Personality Induction and Adaptation by an Empathetic Virtual Agent
A Multimodal Dialogue System for Medical Decision Support inside Virtual Reality
We present a multimodal dialogue system that allows doctors to interact with a medical decision support system in virtual reality (VR). We integrate an interactive visualization of patient records and radiology image dat…
VOILA: An Optimised Dialogue System for Interactively Learning Visually-Grounded Word Meanings (Demonstration System)
We present VOILA: an optimised, multi-modal dialogue agent for interactive learning of visually grounded word meanings from a human user. VOILA is: (1) able to learn new visual categories interactively from users from sc…
Active LearningVerbal indicators of psychological distress in interactive dialogue with a virtual human
Conversational Human Audio-visual Talking Dialogue Generation
Large-scale dyadic interactive audio-visual dialogue (DIAD) datasets provide fundamental data resources for developing humanoid interactive virtual agents and digital humans. However, collecting such data is time-consumi…
Dialogue Generation