paper-with-me

Papers

ALIEN: Implicit Neural Representations for Human Motion Prediction under Arbitrary Latency

2025-01-01 · CVPR 2025 1 · Dong Wei, Xiaoning Sun, Xizhan Gao, Shengxiang Hu, Huaijiang Sun

We investigate a new task in human motion prediction, which aims to forecast future body poses from historically observed sequences while accounting for arbitrary latency. This differs from existing works that assume an ideal scenario where future motions can be "instantaneously" predicted, thereby neglecting time delays caused by network transmission and algorithm execution. Addressing this task requires tackling two key challenges: The length of latency period can vary significantly across samples; the prediction model must be efficient. In this paper, we propose ALIEN, which treats the motion as a continuous function parameterized by a neural network, enabling predictions under any latency condition. By incorporating Mamba-like linear attention as a hyper-network and designing subsequent low-rank modulation, ALIEN efficiently learns a set of implicit neural representation weights from the observed motion to encode instance-specific information. Additionally, our model integrates the primary motion prediction task with an extra-designed variable-delay pose reconstruction task in a unified multi-task learning framework, enhancing its ability to capture richer motion patterns. Extensive experiments demonstrate that our approach outperforms state-of-the-art baselines adapted for our new task, while maintaining competitive performance in traditional prediction setting.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Human motion predictionMambamotion predictionMulti-Task LearningPrediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

What Do Deep Saliency Models Learn about Visual Attention?

2023-10-14 · NeurIPS 2023 11 · Shi Chen, Ming Jiang, Qi Zhao

In recent years, deep saliency models have made significant progress in predicting human visual attention. However, the mechanisms behind their success remain largely unexplained due to the opaque nature of deep neural n…

Saliency Prediction

The discriminant center-surround hypothesis for bottom-up saliency

2007-12-01 · NeurIPS 2007 12 · Dashan Gao, Vijay Mahadevan, Nuno Vasconcelos

The classical hypothesis, that bottom-up saliency is a center-surround process, is combined with a more recent hypothesis that all saliency decisions are optimal in a decision-theoretic sense. The combined hypothesis is …

DeepVS: A Deep Learning Based Video Saliency Prediction Approach

2018-09-01 · ECCV 2018 9 · Lai Jiang, Mai Xu, Tie Liu, Minglang Qiao 외

In this paper, we propose a novel deep learning based video saliency prediction method, named DeepVS. Specifically, we establish a large-scale eye-tracking database of videos (LEDOV), which includes 32 subjects' fixation…

Deep LearningPredictionSaliency PredictionVideo Saliency Detection+1

Visual Saliency Maps Can Apply to Facial Expression Recognition

2018-11-12 · Zhenyue Qin, Jie Wu

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that…

Facial Expression RecognitionFacial Expression Recognition (FER)General ClassificationSaliency Prediction

Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion

2023-11-16 · Smriti Singh, Cornelia Caragea, Junyi Jessy Li

Situations and events evoke emotions in humans, but to what extent do they inform the prediction of emotion detection models? This work investigates how well human-annotated emotion triggers correlate with features that …

Prediction