Didn't see that coming: a survey on non-verbal social human behavior forecasting
Non-verbal social human behavior forecasting has increasingly attracted the interest of the research community in recent years. Its direct applications to human-robot interaction and socially-aware human motion generation make it a very attractive field. In this survey, we define the behavior forecasting problem for multiple interactive agents in a generic way that aims at unifying the fields of social signals prediction and human motion forecasting, traditionally separated. We hold that both problem formulations refer to the same conceptual problem, and identify many shared fundamental challenges: future stochasticity, context awareness, history exploitation, etc. We also propose a taxonomy that comprises methods published in the last 5 years in a very informative way and describes the current main concerns of the community with regard to this problem. In order to promote further research on this field, we also provide a summarised and friendly overview of audiovisual datasets featuring non-acted social interactions. Finally, we describe the most common metrics used in this task and their particular issues.
Code (0)
등록된 구현이 없습니다.
Tasks
Human Behavior ForecastingMotion ForecastingMotion GenerationSimilar Papers 제목 키워드 기반
Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey
Automated co-located human-human interaction analysis has been addressed by the use of nonverbal communication as measurable evidence of social and psychological phenomena. We survey the computing studies (since 2010) de…
Privacy PreservingSurveyUtilization of Non-verbal Behaviour and Social Gaze in Classroom Human-Robot Interaction Communications
This abstract explores classroom Human-Robot Interaction (HRI) scenarios with an emphasis on the adaptation of human-inspired social gaze models in robot cognitive architecture to facilitate a more seamless social intera…
Forecasting Nonverbal Social Signals during Dyadic Interactions with Generative Adversarial Neural Networks
We are approaching a future where social robots will progressively become widespread in many aspects of our daily lives, including education, healthcare, work, and personal use. All of such practical applications require…
Developing Social Robots with Empathetic Non-Verbal Cues Using Large Language Models
We propose augmenting the empathetic capacities of social robots by integrating non-verbal cues. Our primary contribution is the design and labeling of four types of empathetic non-verbal cues, abbreviated as SAFE: Speec…
Language ModelingLanguage ModellingLarge Language ModelMimeQA: Towards Socially-Intelligent Nonverbal Foundation Models
Socially intelligent AI that can understand and interact seamlessly with humans in daily lives is increasingly important as AI becomes more closely integrated with peoples' daily activities. However, current works in art…