Papers Temporal Localization
“Temporal Localization” 태그가 달린 논문 153편 · 필터 해제
Impact of temporal resolution on convolutional recurrent networks for audio tagging and sound event detection
Many state-of-the-art systems for audio tagging and sound event detection employ convolutional recurrent neural architectures. Typically, they are trained in a mean teacher setting to deal with the heterogeneous annotati…
Audio TaggingEvent DetectionSound Event DetectionTemporal LocalizationVideo Swin Transformers for Egocentric Video Understanding @ Ego4D Challenges 2022
We implemented Video Swin Transformer as a base architecture for the tasks of Point-of-No-Return temporal localization and Object State Change Classification. Our method achieved competitive performance on both challenge…
ObjectObject State Change ClassificationTemporal LocalizationVideo UnderstandingLocVTP: Video-Text Pre-training for Temporal Localization
Video-Text Pre-training (VTP) aims to learn transferable representations for various downstream tasks from large-scale web videos. To date, almost all existing VTP methods are limited to retrieval-based downstream tasks,…
RetrievalTemporal LocalizationVideo RetrievalTeam PKU-WICT-MIPL PIC Makeup Temporal Video Grounding Challenge 2022 Technical Report
In this technical report, we briefly introduce the solutions of our team `PKU-WICT-MIPL' for the PIC Makeup Temporal Video Grounding (MTVG) Challenge in ACM-MM 2022. Given an untrimmed makeup video and a step query, the …
SentenceTemporal LocalizationVideo GroundingScalable Temporal Localization of Sensitive Activities in Movies and TV Episodes
To help customers make better-informed viewing choices, video-streaming services try to moderate their content and provide more visibility into which portions of their movies and TV episodes contain age-appropriate mater…
Temporal LocalizationStructured Video Tokens @ Ego4D PNR Temporal Localization Challenge 2022
This technical report describes the SViT approach for the Ego4D Point of No Return (PNR) Temporal Localization Challenge. We propose a learning framework StructureViT (SViT for short), which demonstrates how utilizing th…
Point- of-no-return (PNR) temporal localizationTemporal LocalizationTadML: A fast temporal action detection with Mechanics-MLP
Temporal Action Detection(TAD) is a crucial but challenging task in video understanding.It is aimed at detecting both the type and start-end frame for each action instance in a long, untrimmed video.Most current models a…
Action DetectionOptical Flow EstimationTemporal Action LocalizationTemporal LocalizationEgocentric Video-Language Pretraining
Video-Language Pretraining (VLP), which aims to learn transferable representation to advance a wide range of video-text downstream tasks, has recently received increasing attention. Best performing works rely on large-sc…
Action RecognitionContrastive LearningMoment QueriesMulti-Instance Retrieval+9Stargazer: A transformer-based driver action detection system for intelligent transportation
Distracted driver actions can be dangerous and cause severe accidents. Thus, it is important to detect and eliminate distracted driving behaviors on the road to save lives. To this end, we study driver action detection u…
Action DetectionAction RecognitionTemporal LocalizationTo catch a chorus, verse, intro, or anything else: Analyzing a song with structural functions
Conventional music structure analysis algorithms aim to divide a song into segments and to group them with abstract labels (e.g., 'A', 'B', and 'C'). However, explicitly identifying the function of each segment (e.g., 'v…
Boundary DetectionTemporal LocalizationTemporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchors
We present a model for temporally precise action spotting in videos, which uses a dense set of detection anchors, predicting a detection confidence and corresponding fine-grained temporal displacement for each anchor. We…
Action SpottingData AugmentationTemporal LocalizationContrastive Language-Action Pre-training for Temporal Localization
Long-form video understanding requires designing approaches that are able to temporally localize activities or language. End-to-end training for such tasks is limited by the compute device memory constraints and lack of …
Action LocalizationContrastive LearningFew Shot Temporal Action LocalizationTemporal Action Localization+2TubeDETR: Spatio-Temporal Video Grounding with Transformers
We consider the problem of localizing a spatio-temporal tube in a video corresponding to a given text query. This is a challenging task that requires the joint and efficient modeling of temporal, spatial and multi-modal …
DecoderLanguage-Based Temporal LocalizationNatural Language Visual Groundingobject-detection+6Unsupervised Pre-training for Temporal Action Localization Tasks
Unsupervised video representation learning has made remarkable achievements in recent years. However, most existing methods are designed and optimized for video classification. These pre-trained models can be sub-optimal…
Action LocalizationContrastive LearningRepresentation LearningTemporal Action Localization+3OpenTAL: Towards Open Set Temporal Action Localization
Temporal Action Localization (TAL) has experienced remarkable success under the supervised learning paradigm. However, existing TAL methods are rooted in the closed set assumption, which cannot handle the inevitable unkn…
Action ClassificationAction LocalizationClassificationTemporal Action Localization+1End-to-End Semi-Supervised Learning for Video Action Detection
In this work, we focus on semi-supervised learning for video action detection which utilizes both labeled as well as unlabeled data. We propose a simple end-to-end consistency based approach which effectively utilizes th…
Action DetectionClassification ConsistencySemantic SegmentationSemi-Supervised Video Action Detection+4Universal Prototype Transport for Zero-Shot Action Recognition and Localization
This work addresses the problem of recognizing action categories in videos when no training examples are available. The current state-of-the-art enables such a zero-shot recognition by learning universal mappings from vi…
Action RecognitionObjectPositionTemporal Localization+3When Did It Happen? Duration-informed Temporal Localization of Narrated Actions in Vlogs
We consider the task of temporal human action localization in lifestyle vlogs. We introduce a novel dataset consisting of manual annotations of temporal localization for 13,000 narrated actions in 1,200 video clips. We p…
Action LocalizationTemporal Action LocalizationTemporal LocalizationOWL (Observe, Watch, Listen): Audiovisual Temporal Context for Localizing Actions in Egocentric Videos
Egocentric videos capture sequences of human activities from a first-person perspective and can provide rich multimodal signals. However, most current localization methods use third-person videos and only incorporate vis…
Action LocalizationTemporal Action LocalizationTemporal LocalizationA benchmark of state-of-the-art sound event detection systems evaluated on synthetic soundscapes
This paper proposes a benchmark of submissions to Detection and Classification Acoustic Scene and Events 2021 Challenge (DCASE) Task 4 representing a sampling of the state-of-the-art in Sound Event Detection task. The su…
Data AugmentationEvent DetectionSegmentationSound Event Detection+1