ALIEN: Implicit Neural Representations for Human Motion Prediction under Arbitrary Latency
We investigate a new task in human motion prediction, which aims to forecast future body poses from historically observed sequences while accounting for arbitrary latency. This differs from existing works that assume an ideal scenario where future motions can be "instantaneously" predicted, thereby neglecting time delays caused by network transmission and algorithm execution. Addressing this task requires tackling two key challenges: The length of latency period can vary significantly across samples; the prediction model must be efficient. In this paper, we propose ALIEN, which treats the motion as a continuous function parameterized by a neural network, enabling predictions under any latency condition. By incorporating Mamba-like linear attention as a hyper-network and designing subsequent low-rank modulation, ALIEN efficiently learns a set of implicit neural representation weights from the observed motion to encode instance-specific information. Additionally, our model integrates the primary motion prediction task with an extra-designed variable-delay pose reconstruction task in a unified multi-task learning framework, enhancing its ability to capture richer motion patterns. Extensive experiments demonstrate that our approach outperforms state-of-the-art baselines adapted for our new task, while maintaining competitive performance in traditional prediction setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Human motion predictionMambamotion predictionMulti-Task LearningPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
What Do Deep Saliency Models Learn about Visual Attention?
In recent years, deep saliency models have made significant progress in predicting human visual attention. However, the mechanisms behind their success remain largely unexplained due to the opaque nature of deep neural n…
Saliency PredictionThe discriminant center-surround hypothesis for bottom-up saliency
The classical hypothesis, that bottom-up saliency is a center-surround process, is combined with a more recent hypothesis that all saliency decisions are optimal in a decision-theoretic sense. The combined hypothesis is …
DeepVS: A Deep Learning Based Video Saliency Prediction Approach
In this paper, we propose a novel deep learning based video saliency prediction method, named DeepVS. Specifically, we establish a large-scale eye-tracking database of videos (LEDOV), which includes 32 subjects' fixation…
Deep LearningPredictionSaliency PredictionVideo Saliency Detection+1Visual Saliency Maps Can Apply to Facial Expression Recognition
Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that…
Facial Expression RecognitionFacial Expression Recognition (FER)General ClassificationSaliency PredictionLanguage Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion
Situations and events evoke emotions in humans, but to what extent do they inform the prediction of emotion detection models? This work investigates how well human-annotated emotion triggers correlate with features that …
Prediction