LingoMotion: An Interpretable and Unambiguous Symbolic Representation for Human Motion
Existing representations for human motion, such as MotionGPT, often operate as black-box latent vectors with limited interpretability and build on joint positions which can cause ambiguity. Inspired by the hierarchical structure of natural languages - from letters to words, phrases, and sentences - we propose LingoMotion, a motion language that facilitates interpretable and unambiguous symbolic representation for both simple and complex human motion. In this paper, we introduce the concept design of LingoMotion, including the definitions of motion alphabet based on joint angles, the morphology for forming words and phrases to describe simple actions like walking and their attributes like speed and scale, as well as the syntax for describing more complex human activities with sequences of words and phrases. The preliminary results, including the implementation and evaluation of motion alphabet using a large-scale motion dataset Motion-X, demonstrate the high fidelity of motion representation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Explainable and Interpretable Diabetic Retinopathy Classification Based on Neural-Symbolic Learning
In this paper, we propose an explainable and interpretable diabetic retinopathy (ExplainDR) classification model based on neural-symbolic learning. To gain explainability, a highlevel symbolic representation should be co…
ClassificationDecision MakingDisease PredictionA Symbolic Representation of Human Posture for Interpretable Learning and Reasoning
Robots that interact with humans in a physical space or application need to think about the person's posture, which typically comes from visual sensors like cameras and infra-red. Artificial intelligence and machine lear…
Activity RecognitionSpatial ReasoningNeurosymbolic Framework for Concept-Driven Logical Reasoning in Skeleton-Based Human Action Recognition
Skeleton-based human activity recognition has achieved strong empirical performance, yet most existing models remain black boxes and difficult to interpret. In this work, we introduce a neurosymbolic formulation of skele…
Human Activity RecognitionRepresentation LearningAction UnderstandingAction RecognitionBASIL: Best-Action Symbolic Interpretable Learning for Evolving Compact RL Policies
The quest for interpretable reinforcement learning is a grand challenge for the deployment of autonomous decision-making systems in safety-critical applications. Modern deep reinforcement learning approaches, while power…
AcrobotDeep Reinforcement LearningDiversityreinforcement-learning+1Symbolic Branch Networks: Tree-Inherited Neural Models for Interpretable Multiclass Classification
Symbolic Branch Networks (SBNs) are neural models whose architecture is inherited directly from an ensemble of decision trees. Each root-to-parent-of-leaf decision path is mapped to a hidden neuron, and the matrices $W_{…