Papers Action Localization
“Action Localization” 태그가 달린 논문 369편 · 필터 해제
The Surprising Effectiveness of Multimodal Large Language Models for Video Moment Retrieval
Recent studies have shown promising results in utilizing multimodal large language models (MLLMs) for computer vision tasks such as object detection and semantic segmentation. However, many challenging video tasks remain…
Action LocalizationMoment RetrievalNatural Language Moment Retrievalobject-detection+4Open-Vocabulary Temporal Action Localization using Multimodal Guidance
Open-Vocabulary Temporal Action Localization (OVTAL) enables a model to recognize any desired action category in videos without the need to explicitly curate training data for all categories. However, this flexibility po…
Action LocalizationLanguage ModellingLarge Language ModelTemporal Action LocalizationSelf-supervised Multi-actor Social Activity Understanding in Streaming Videos
This work addresses the problem of Social Activity Recognition (SAR), a critical component in real-world tasks like surveillance and assistive robotics. Unlike traditional event understanding approaches, SAR necessitates…
Action LocalizationActivity RecognitionGroup Activity RecognitionRelational ReasoningEgoExo-Fitness: Towards Egocentric and Exocentric Full-Body Action Understanding
We present EgoExo-Fitness, a new full-body action understanding dataset, featuring fitness sequence videos recorded from synchronized egocentric and fixed exocentric (third-person) cameras. Compared with existing full-bo…
Action ClassificationAction LocalizationAction UnderstandingViTALS: Vision Transformer for Action Localization in Surgical Nephrectomy
Surgical action localization is a challenging computer vision problem. While it has promising applications including automated training of surgery procedures, surgical workflow optimization, etc., appropriate model desig…
Action LocalizationSFMViT: SlowFast Meet ViT in Chaotic World
The task of spatiotemporal action localization in chaotic scenes is a challenging task toward advanced video understanding. Paving the way with high-quality video feature extraction and enhancing the precision of detecto…
Action LocalizationVideo UnderstandingSTAT: Towards Generalizable Temporal Action Localization
Weakly-supervised temporal action localization (WTAL) aims to recognize and localize action instances with only video-level labels. Despite the significant progress, existing methods suffer from severe performance degrad…
Action LocalizationTemporal Action LocalizationWeakly-supervised Temporal Action LocalizationDeepLocalization: Using change point detection for Temporal Action Localization
In this study, we introduce DeepLocalization, an innovative framework devised for the real-time localization of actions tailored explicitly for monitoring driver behavior. Utilizing the power of advanced deep learning me…
Action LocalizationChange Point DetectionEvent DetectionLanguage Modeling+4Weakly supervised temporal action localization with actionness-guided false positive suppression
Weakly supervised temporal action localization aims to locate the temporal boundaries of action instances in untrimmed videos using video-level labels and assign them the corresponding action category. Generally, it is s…
Action LocalizationTemporal Action LocalizationWeakly Supervised Action LocalizationWeakly-supervised Temporal Action LocalizationTest-Time Zero-Shot Temporal Action Localization
Zero-Shot Temporal Action Localization (ZS-TAL) seeks to identify and locate actions in untrimmed videos unseen during training. Existing ZS-TAL methods involve fine-tuning a model on a large amount of annotated training…
Action LocalizationLanguage ModellingPseudo LabelSelf-Supervised Learning+2Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorder
Autism Spectrum Disorder (ASD) presents significant challenges in early diagnosis and intervention, impacting children and their families. With prevalence rates rising, there is a critical need for accessible and efficie…
Action LocalizationTemporal Action LocalizationUniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization
Video localization tasks aim to temporally locate specific instances in videos, including temporal action localization (TAL), sound event detection (SED) and audio-visual event localization (AVEL). Existing methods over-…
Action Localizationaudio-visual event localizationEvent DetectionSound Event Detection+1ASTRA: An Action Spotting TRAnsformer for Soccer Videos
In this paper, we introduce ASTRA, a Transformer-based model designed for the task of Action Spotting in soccer matches. ASTRA addresses several challenges inherent in the task and dataset, including the requirement for …
Action LocalizationAction SpottingDecoderLoSA: Long-Short-range Adapter for Scaling End-to-End Temporal Action Localization
Temporal Action Localization (TAL) involves localizing and classifying action snippets in an untrimmed video. The emergence of large video foundation models has led RGB-only video backbones to outperform previous methods…
Action LocalizationGPUOptical Flow EstimationTemporal Action Localization+1PLOT-TAL -- Prompt Learning with Optimal Transport for Few-Shot Temporal Action Localization
This paper introduces a novel approach to temporal action localization (TAL) in few-shot learning. Our work addresses the inherent limitations of conventional single-prompt learning methods that often lead to overfitting…
Action LocalizationDiversityFew-Shot LearningFew Shot Temporal Action Localization+2Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes
The crux of semi-supervised temporal action localization (SS-TAL) lies in excavating valuable information from abundant unlabeled videos. However, current approaches predominantly focus on building models that are robust…
Action LocalizationTemporal Action LocalizationBID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin
Skeleton-based motion representations are robust for action localization and understanding for their invariance to perspective, lighting, and occlusion, compared with images. Yet, they are often ambiguous and incomplete …
Action LocalizationTemporal Action LocalizationUnsupervised Pre-trainingDensity-Guided Label Smoothing for Temporal Localization of Driving Actions
Temporal localization of driving actions plays a crucial role in advanced driver-assistance systems and naturalistic driving studies. However, this is a challenging task due to strict requirements for robustness, reliabi…
Action LocalizationAction RecognitionTemporal Action LocalizationTemporal LocalizationCutup and Detect: Human Fall Detection on Cutup Untrimmed Videos Using a Large Foundational Video Understanding Model
This work explores the performance of a large video understanding foundation model on the downstream task of human fall detection on untrimmed video and leverages a pretrained vision transformer for multi-class action de…
Action DetectionAction LocalizationTemporal Action LocalizationVideo UnderstandingRealigning Confidence with Temporal Saliency Information for Point-Level Weakly-Supervised Temporal Action Localization
Point-level weakly-supervised temporal action localization (P-TAL) aims to localize action instances in untrimmed videos through the use of single-point annotations in each instance. Existing methods predict the clas…
Action LocalizationTemporal Action LocalizationWeakly-supervised Temporal Action Localization