Intention Action Anticipation Model with Guide-Feedback Loop Mechanism
Anticipating human intention from videos has broad applications, such as automatic driving, robot assistive technology, and virtual reality. This study addresses the problem of intention action anticipation using egocentric video sequences to estimate actions that indicate human intention. We propose a Hierarchical Complete-Recent (HCR) information fusion model that makes full use of the features of the entire video sequence (i.e., complete features) and the features of the video tail sequence (i.e., recent features). The HCR model has two primary mechanisms. The Guide-Feedback Loop (GFL) mechanism is proposed to model the relation between one recent feature and one complete feature. Based on GFL, the MultiComplete-Recent Feature Aggregation (MCRFA) module is proposed to model the relation of one recent feature with multiscale complete features. Based on GFL and MCRFA, the HCR model can hierarchically explore the rich interrelationships between multiscale complete features and multiscale recent features. Through comparative and ablation experiments, we validate the effectiveness of our model on two well-known public datasets: EPIC-Kitchens and EGTEA Gaze+.
Code (0)
등록된 구현이 없습니다.
Tasks
Action AnticipationRelationSimilar Papers 제목 키워드 기반
Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention
Humans utilize their gaze to concentrate on essential information while perceiving and interpreting intentions in videos. Incorporating human gaze into computational algorithms can significantly enhance model performance…
Action AnticipationGraph Neural NetworkIntent DetectionVideo UnderstandingIntention-Conditioned Long-Term Human Egocentric Action Forecasting
To anticipate how a human would act in the future, it is essential to understand the human intention since it guides the human towards a certain goal. In this paper, we propose a hierarchical architecture which assumes a…
Action AnticipationLong Term Action AnticipationIntention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipation
Long-term action anticipation from egocentric video is critical for applications such as human-computer interaction and assistive technologies, where anticipating user intent enables proactive and context-aware AI assist…
Reinforcement LearningAction AnticipationFactCheck: Feasibility-aware Long-term Action Anticipation with Multi-agent Collaboration
Long-term action anticipation (LTA) aims to predict an ordered sequence of future verb-noun actions from a partially observed video. While this task serves as the foundation for embodied intelligence, anticipating physic…
Action AnticipationAction RecognitionAction-Guided Attention for Video Action Anticipation
Anticipating future actions in videos is challenging, as the observed frames provide only evidence of past activities, requiring the inference of latent intentions to predict upcoming actions. Existing transformer-based …
Action Anticipation