Anticipating human actions by correlating past with the future with Jaccard similarity measures
We propose a framework for early action recognition and anticipation by correlating past features with the future using three novel similarity measures called Jaccard vector similarity, Jaccard cross-correlation and Jaccard Frobenius inner product over covariances. Using these combinations of novel losses and using our framework, we obtain state-of-the-art results for early action recognition in UCF101 and JHMDB datasets by obtaining 91.7 % and 83.5 % accuracy respectively for an observation percentage of 20. Similarly, we obtain state-of-the-art results for Epic-Kitchen55 and Breakfast datasets for action anticipation by obtaining 20.35 and 41.8 top-1 accuracy respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Action AnticipationAction RecognitionSimilar Papers 제목 키워드 기반
A-ACT: Action Anticipation through Cycle Transformations
While action anticipation has garnered a lot of research interest recently, most of the works focus on anticipating future action directly through observed visual cues only. In this work, we take a step back to analyze h…
Action AnticipationFuture Transformer for Long-term Action Anticipation
The task of predicting future actions from a video is crucial for a real-world agent interacting with others. When anticipating actions in the distant future, we humans typically consider long-term relations over the who…
Action AnticipationLong Term Action AnticipationLong Term AnticipationHuman Motion Anticipation with Symbolic Label
Anticipating human motion depends on two factors: the past motion and the person's intention. While the first factor has been extensively utilized to forecast short sequences of human motion, the second one remains elusi…
Motion ForecastingLearning Spatio-Temporal Structure from RGB-D Videos for Human Activity Detection and Anticipation
We consider the problem of detecting past activities as well as anticipating which activity will happen in the future and how. We start by modeling the rich spatio-temporal relations between human poses and objects (call…
Action DetectionActivity DetectionSkeleton Based Action RecognitionAnticipating many futures: Online human motion prediction and synthesis for human-robot collaboration
Fluent and safe interactions of humans and robots require both partners to anticipate the others' actions. A common approach to human intention inference is to model specific trajectories towards known goals with supervi…
Human motion predictionmotion prediction