paper-with-me

Papers

Video Action Understanding

2020-10-13 · Matthew Hutchinson, Vijay Gadepally

Many believe that the successes of deep learning on image understanding problems can be replicated in the realm of video understanding. However, due to the scale and temporal nature of video, the span of video understanding problems and the set of proposed deep learning solutions is arguably wider and more diverse than those of their 2D image siblings. Finding, identifying, and predicting actions are a few of the most salient tasks in this emerging and rapidly evolving field. With a pedagogical emphasis, this tutorial introduces and systematizes fundamental topics, basic concepts, and notable examples in supervised video action understanding. Specifically, we clarify a taxonomy of action problems, catalog and highlight video datasets, describe common video data preparation methods, present the building blocks of state-of-the art deep learning model architectures, and formalize domain-specific metrics to baseline proposed solutions. This tutorial is intended to be accessible to a general computer science audience and assumes a conceptual understanding of supervised learning.

📄 PDF Abstract BibTeX arXiv:2010.06647

Code (1)

hutch-matt/vau-tutorial 공식 구현

Tasks

Action UnderstandingDeep LearningVideo Understanding

Similar Papers 제목 키워드 기반

Open-Vocabulary Video Relation Extraction

2023-12-25 · Wentao Tian, Zheng Wang, Yuqian Fu, Jingjing Chen 외

A comprehensive understanding of videos is inseparable from describing the action with its contextual action-object interactions. However, many current video understanding tasks prioritize general action classification a…

Action ClassificationAction UnderstandingRelationRelation Extraction+1

Contextual Explainable Video Representation: Human Perception-based Understanding

2022-12-12 · Khoa Vo, Kashu Yamazaki, Phong X. Nguyen, Phat Nguyen 외

Video understanding is a growing field and a subject of intense research, which includes many interesting tasks to understanding both spatial and temporal information, e.g., action detection, action recognition, video ca…

Action DetectionAction RecognitionRetrievalVideo Captioning+2

Grounded Objects and Interactions for Video Captioning

2017-11-16 · Chih-Yao Ma, Asim Kadav, Iain Melvin, Zsolt Kira 외

We address the problem of video captioning by grounding language generation on object interactions in the video. Existing work mostly focuses on overall scene understanding with often limited or no emphasis on object int…

ObjectScene UnderstandingText GenerationVideo Captioning+1

NAVERO: Unlocking Fine-Grained Semantics for Video-Language Compositionality

2024-08-18 · Chaofan Tao, Gukyeong Kwon, Varad Gunjal, Hao Yang 외

We study the capability of Video-Language (VidL) models in understanding compositions between objects, attributes, actions and their relations. Composition understanding becomes particularly challenging for video data si…

RetrievalText RetrievalVideo RetrievalVideo-Text Retrieval

Action Scene Graphs for Long-Form Understanding of Egocentric Videos

2023-12-06 · CVPR 2024 1 · Ivan Rodin, Antonino Furnari, Kyle Min, Subarna Tripathi 외

We present Egocentric Action Scene Graphs (EASGs), a new representation for long-form understanding of egocentric videos. EASGs extend standard manually-annotated representations of egocentric videos, such as verb-noun a…

Action AnticipationFormVideo Understanding