paper-with-me

Papers

Leveraging Self-Supervised Training for Unintentional Action Recognition

2022-09-23 · Enea Duka, Anna Kukleva, Bernt Schiele

Unintentional actions are rare occurrences that are difficult to define precisely and that are highly dependent on the temporal context of the action. In this work, we explore such actions and seek to identify the points in videos where the actions transition from intentional to unintentional. We propose a multi-stage framework that exploits inherent biases such as motion speed, motion direction, and order to recognize unintentional actions. To enhance representations via self-supervised training for the task of unintentional action recognition we propose temporal transformations, called Temporal Transformations of Inherent Biases of Unintentional Actions (T2IBUA). The multi-stage approach models the temporal information on both the level of individual frames and full clips. These enhanced representations show strong performance for unintentional action recognition tasks. We provide an extensive ablation study of our framework and report results that significantly improve over the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2209.11870

Code (0)

등록된 구현이 없습니다.

Tasks

Action Recognition

Similar Papers 제목 키워드 기반

Self-supervised Learning for Unintentional Action Prediction

2022-09-24 · Olga Zatsarynna, Yazan Abu Farha, Juergen Gall

Distinguishing if an action is performed as intended or if an intended action fails is an important skill that not only humans have, but that is also important for intelligent systems that operate in human environments. …

Action ClassificationPredictionRepresentation LearningSelf-Supervised Learning

Oops! Predicting Unintentional Action in Video

2019-11-25 · CVPR 2020 6 · Dave Epstein, Boyuan Chen, Carl Vondrick

From just a short glance at a video, we can often tell whether a person's action is intentional or not. Can we train a model to recognize this? We introduce a dataset of in-the-wild videos of unintentional action, as wel…

Learning Goals from Failure

2020-06-28 · CVPR 2021 1 · Dave Epstein, Carl Vondrick

We introduce a framework that predicts the goals behind observable human action in video. Motivated by evidence in developmental psychology, we leverage video of unintentional action to learn video representations of goa…

Representation Learning

PLSM: A Parallelized Liquid State Machine for Unintentional Action Detection

2021-05-06 · Dipayan Das, Saumik Bhattacharya, Umapada Pal, Sukalpa Chanda

Reservoir Computing (RC) offers a viable option to deploy AI algorithms on low-end embedded system platforms. Liquid State Machine (LSM) is a bio-inspired RC model that mimics the cortical microcircuits and uses spiking …

Action DetectionGPU

Tragedy Plus Time: Capturing Unintended Human Activities from Weakly-labeled Videos

2022-04-28 · Arnav Chakravarthy, Zhiyuan Fang, Yezhou Yang

In videos that contain actions performed unintentionally, agents do not achieve their desired goals. In such videos, it is challenging for computer vision systems to understand high-level concepts such as goal-directed b…

Action UnderstandingVideo Captioning