paper-with-me

홈 › Papers

Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior

2026-09-15 · Farnaz Soleimani, Abdelghani Chibani, Yacine Amirat, Ghazaleh Khodabandelou arxiv

Assistive autonomous systems must anticipate human goals before an observed behavior is complete. This article formulates anticipation as goal inference from a partially observed multimodal episode together with structured prediction of the remaining behavior, rather than exact motor forecasting. A compact Hierarchical Planning Decoder (HPD) is attached to a frozen neuro-symbolic recognition encoder and predicts, at four ontological levels, the next actions, the remaining activities and low-level intentions, and the episode high-level intention(HLI). The decoder is trained with soft neuro-symbolic regularization combining transition-coherence and hierarchical continuity losses, and is decoded with hard reachability masks that enforce ontological validity at inference. On a compositional four-level benchmark of 15,002 multimodal episodes built over NTU RGB+D 120 features, three headline properties are observed together. The advantage over the strongest sequential baseline grows with the anticipation horizon, from +1.7 points at step 1 to +7.3 points at step 3 (top-5). Under compositional generalization, where one parent association per multi-parent low level intention is held out, this advantage widens to +4.9 points at step 1. At the episode level, 96.8% of anticipated trajectories satisfy the joint logic constraints, above the 88.1% strongest-baseline value and the 73.9% ground-truth floor; soft logic terms alone account for a 59.8 to 71.1% relative reduction of HLI-reachability violations, and the hard masks then eliminate them entirely. Neural generation supplies predictive ranking, symbolic constraints supply onto logical validity, and their combination yields coherent hierarchical anticipation while exposing remaining challenges in compositional goal generalization and unordered set prediction.

📄 PDF Abstract BibTeX arXiv:2609.17064

Code (0)

등록된 구현이 없습니다.

Tasks

Structured Prediction

Similar Papers 제목 키워드 기반

Intention-Conditioned Long-Term Human Egocentric Action Forecasting

2022-07-25 · Esteve Valls Mascaro, Hyemin Ahn, Dongheui Lee

To anticipate how a human would act in the future, it is essential to understand the human intention since it guides the human towards a certain goal. In this paper, we propose a hierarchical architecture which assumes a…

Action AnticipationLong Term Action Anticipation

Human Motion Anticipation with Symbolic Label

2019-12-12 · Julian Tanke, Andreas Weber, Juergen Gall

Anticipating human motion depends on two factors: the past motion and the person's intention. While the first factor has been extensively utilized to forecast short sequences of human motion, the second one remains elusi…

Motion Forecasting

Intention Action Anticipation Model with Guide-Feedback Loop Mechanism

2024-03-19 · Zongnan Ma, Fuchun Zhang, Zhixiong Nan, Yao Ge

Anticipating human intention from videos has broad applications, such as automatic driving, robot assistive technology, and virtual reality. This study addresses the problem of intention action anticipation using egocent…

Action AnticipationRelation

HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs

2023-09-28 · Esteve Valls Mascaro, Daniel Sliwowski, Dongheui Lee

Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate o…

Human-Object Interaction AnticipationHuman-Object Interaction Detection

Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention

2024-04-10 · Suleyman Ozdel, Yao Rong, Berat Mert Albaba, Yen-Ling Kuo 외

Humans utilize their gaze to concentrate on essential information while perceiving and interpreting intentions in videos. Incorporating human gaze into computational algorithms can significantly enhance model performance…

Action AnticipationGraph Neural NetworkIntent DetectionVideo Understanding