Generating Simulations of Motion Events from Verbal Descriptions
In this paper, we describe a computational model for motion events in natural language that maps from linguistic expressions, through a dynamic event interpretation, into three-dimensional temporal simulations in a model. Starting with the model from (Pustejovsky and Moszkowicz, 2011), we analyze motion events using temporally-traced Labelled Transition Systems. We model the distinction between path- and manner-motion in an operational semantics, and further distinguish different types of manner-of-motion verbs in terms of the mereo-topological relations that hold throughout the process of movement. From these representations, we generate minimal models, which are realized as three-dimensional simulations in software developed with the game engine, Unity. The generated simulations act as a conceptual "debugger" for the semantics of different motion verbs: that is, by testing for consistency and informativeness in the model, simulations expose the presuppositions associated with linguistic expressions and their compositions. Because the model generation component is still incomplete, this paper focuses on an implementation which maps directly from linguistic interpretations into the Unity code snippets that create the simulations.
Code (0)
등록된 구현이 없습니다.
Tasks
InformativenessUnitySimilar Papers 제목 키워드 기반
An Analysis of Emotion Communication Channels in Fan Fiction: Towards Emotional Storytelling
Centrality of emotion for the stories told by humans is underpinned by numerous studies in literature and psychology. The research in automatic storytelling has recently turned towards emotional storytelling, in which ch…
An Analysis of Emotion Communication Channels in Fan-Fiction: Towards Emotional Storytelling
Centrality of emotion for the stories told by humans is underpinned by numerous studies in literature and psychology. The research in automatic storytelling has recently turned towards emotional storytelling, in which ch…
Multimodal Semantic Simulations of Linguistically Underspecified Motion Events
In this paper, we describe a system for generating three-dimensional visual simulations of natural language motion expressions. We use a rich formal model of events and their participants to generate simulations that sat…
Beyond Vision: How Large Language Models Interpret Facial Expressions from Valence-Arousal Values
Large Language Models primarily operate through text-based inputs and outputs, yet human emotion is communicated through both verbal and non-verbal cues, including facial expressions. While Vision-Language Models analyze…
Learning Emotion Representations from Verbal and Nonverbal Communication
Emotion understanding is an essential but highly challenging component of artificial general intelligence. The absence of extensively annotated datasets has significantly impeded advancements in this field. We present Em…
Contrastive LearningEmotion RecognitionEmotion Recognition in Context