paper-with-me

Papers

Classification Matters: Improving Video Action Detection with Class-Specific Attention

2024-07-29 · Jinsung Lee, Taeoh Kim, Inwoong Lee, Minho Shim, Dongyoon Wee, Minsu Cho, Suha Kwak

Video action detection (VAD) aims to detect actors and classify their actions in a video. We figure that VAD suffers more from classification rather than localization of actors. Hence, we analyze how prevailing methods form features for classification and find that they prioritize actor regions, yet often overlooking the essential contextual information necessary for accurate classification. Accordingly, we propose to reduce the bias toward actor and encourage paying attention to the context that is relevant to each action class. By assigning a class-dedicated query to each action class, our model can dynamically determine where to focus for effective classification. The proposed model demonstrates superior performance on three challenging benchmarks with significantly fewer parameters and less computation.

📄 PDF Abstract BibTeX arXiv:2407.19698

Code (0)

등록된 구현이 없습니다.

Tasks

Action DetectionClassificationVideo Action Detection

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detection

2021-07-28 · Michail Tsiaousis, Gertjan Burghouts, Fieke Hillerström, Peter van der Putten

The dominant paradigm in spatiotemporal action detection is to classify actions using spatiotemporal features learned by 2D or 3D Convolutional Networks. We argue that several actions are characterized by their context, …

Action DetectionHuman-Object Interaction DetectionOptical Flow Estimation

Watch Only Once: An End-to-End Video Action Detection Framework

2021-01-01 · ICCV 2021 10 · Shoufa Chen, Peize Sun, Enze Xie, Chongjian Ge 외

We propose an end-to-end pipeline, named Watch Once Only (WOO), for video action detection. Current methods either decouple video action detection task into separated stages of actor localization and action classific…

Action ClassificationAction DetectionClassificationVideo Action Detection

Untrimmed Video Classification for Activity Detection: submission to ActivityNet Challenge

2016-07-07 · Gurkirt Singh, Fabio Cuzzolin

Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal det…

Action DetectionActivity DetectionActivity RecognitionBinary Classification+4

VideoCapsuleNet: A Simplified Network for Action Detection

2018-05-21 · NeurIPS 2018 12 · Kevin Duarte, Yogesh S Rawat, Mubarak Shah

The recent advances in Deep Convolutional Neural Networks (DCNNs) have shown extremely good results for video human action classification, however, action detection is still a challenging problem. The current action dete…

Action ClassificationAction DetectionAction LocalizationAction Segmentation+4

Sports Video: Fine-Grained Action Detection and Classification of Table Tennis Strokes from Videos for MediaEval 2021

2021-12-16 · Pierre-Etienne Martin, Jordan Calandre, Boris Mansencal, Jenny Benois-Pineau 외

Sports video analysis is a prevalent research topic due to the variety of application areas, ranging from multimedia intelligent devices with user-tailored digests up to analysis of athletes' performance. The Sports Vide…

Action DetectionFine-Grained Action Detection