Papers Temporal Action Localization
“Temporal Action Localization” 태그가 달린 논문 1,503편 · 필터 해제
Exploring Explainability in Video Action Recognition
Image Classification and Video Action Recognition are perhaps the two most foundational tasks in computer vision. Consequently, explaining the inner workings of trained deep neural networks is of prime importance. While …
Action RecognitionClassificationimage-classificationImage Classification+1Multimodal Attack Detection for Action Recognition Models
Adversarial machine learning attacks on video action recognition models is a growing research area and many effective attacks were introduced in recent years. These attacks show that action recognition models can be brea…
Action RecognitionTemporal Action LocalizationMSSTNet: A Multi-Scale Spatio-Temporal CNN-Transformer Network for Dynamic Facial Expression Recognition
Unlike typical video action recognition, Dynamic Facial Expression Recognition (DFER) does not involve distinct moving targets but relies on localized changes in facial muscles. Addressing this distinctive attribute, we …
Action RecognitionAttributeDynamic Facial Expression RecognitionFacial Expression Recognition+1Test-Time Zero-Shot Temporal Action Localization
Zero-Shot Temporal Action Localization (ZS-TAL) seeks to identify and locate actions in untrimmed videos unseen during training. Existing ZS-TAL methods involve fine-tuning a model on a large amount of annotated training…
Action LocalizationLanguage ModellingPseudo LabelSelf-Supervised Learning+2Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorder
Autism Spectrum Disorder (ASD) presents significant challenges in early diagnosis and intervention, impacting children and their families. With prevalence rates rising, there is a critical need for accessible and efficie…
Action LocalizationTemporal Action LocalizationUniMD: Towards Unifying Moment Retrieval and Temporal Action Detection
Temporal Action Detection (TAD) focuses on detecting pre-defined actions, while Moment Retrieval (MR) aims to identify the events described by open-ended natural language within untrimmed videos. Despite that they focus …
Action DetectionMoment QueriesMoment RetrievalNatural Language Moment Retrieval+2PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos
While current methods have shown promising progress on estimating 3D human motion from monocular videos, their motion estimates are often physically unrealistic because they mainly consider kinematics. In this paper, we …
Action RecognitionDecoderHuman DynamicsTemporal Action LocalizationUniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization
Video localization tasks aim to temporally locate specific instances in videos, including temporal action localization (TAL), sound event detection (SED) and audio-visual event localization (AVEL). Existing methods over-…
Action Localizationaudio-visual event localizationEvent DetectionSound Event Detection+1Language Model Guided Interpretable Video Action Reasoning
While neural networks have excelled in video action recognition tasks, their black-box nature often obscures the understanding of their decision-making processes. Recent approaches used inherently interpretable models to…
Action RecognitionDecision MakingLanguage ModelingLanguage Modelling+3LoSA: Long-Short-range Adapter for Scaling End-to-End Temporal Action Localization
Temporal Action Localization (TAL) involves localizing and classifying action snippets in an untrimmed video. The emergence of large video foundation models has led RGB-only video backbones to outperform previous methods…
Action LocalizationGPUOptical Flow EstimationTemporal Action Localization+1Dual DETRs for Multi-Label Temporal Action Detection
Temporal Action Detection (TAD) aims to identify the action boundaries and the corresponding category within untrimmed videos. Inspired by the success of DETR in object detection, several methods have adapted the query-b…
Action Detectionobject-detectionObject DetectionTemporal Action LocalizationPLOT-TAL -- Prompt Learning with Optimal Transport for Few-Shot Temporal Action Localization
This paper introduces a novel approach to temporal action localization (TAL) in few-shot learning. Our work addresses the inherent limitations of conventional single-prompt learning methods that often lead to overfitting…
Action LocalizationDiversityFew-Shot LearningFew Shot Temporal Action Localization+2InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
We introduce InternVideo2, a new family of video foundation models (ViFM) that achieve the state-of-the-art results in video recognition, video-text tasks, and video-centric dialogue. Our core design is a progressive tra…
Action ClassificationAction RecognitionAudio ClassificationContrastive Learning+13A Lie Group Approach to Riemannian Batch Normalization
Manifold-valued measurements exist in numerous applications within computer vision and machine learning. Recent studies have extended Deep Neural Networks (DNNs) to manifolds, and concomitantly, normalization techniques …
Action RecognitionEEGTemporal Action LocalizationBoosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes
The crux of semi-supervised temporal action localization (SS-TAL) lies in excavating valuable information from abundant unlabeled videos. However, current approaches predominantly focus on building models that are robust…
Action LocalizationTemporal Action LocalizationSkeleton-Based Human Action Recognition with Noisy Labels
Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and a…
Action RecognitionDenoisingMixture-of-ExpertsSkeleton Based Action Recognition+2Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding
Understanding videos is one of the fundamental directions in computer vision research, with extensive efforts dedicated to exploring various architectures such as RNN, 3D CNN, and Transformers. The newly proposed archite…
MambaMoment RetrievalTemporal Action LocalizationVideo UnderstandingLeveraging Foundation Model Automatic Data Augmentation Strategies and Skeletal Points for Hands Action Recognition in Industrial Assembly Lines
On modern industrial assembly lines, many intelligent algorithms have been developed to replace or supervise workers. However, we found that there were bottlenecks in both training datasets and real-time performance when…
Action RecognitionData AugmentationTemporal Action LocalizationBID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin
Skeleton-based motion representations are robust for action localization and understanding for their invariance to perspective, lighting, and occlusion, compared with images. Yet, they are often ambiguous and incomplete …
Action LocalizationTemporal Action LocalizationUnsupervised Pre-trainingDeep Learning Approaches for Human Action Recognition in Video Data
Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both…
Action RecognitionAction Recognition In VideosDeep LearningSports Analytics+2