Papers Temporal Localization
“Temporal Localization” 태그가 달린 논문 153편 · 필터 해제
Boundary-sensitive Pre-training for Temporal Localization in Videos
Many video analysis tasks require temporal localization thus detection of content changes. However, most existing models developed for these tasks are pre-trained on general video action classification tasks. This is bec…
Action ClassificationClassificationGeneral ClassificationTemporal Action Localization+1VLG-Net: Video-Language Graph Matching Network for Video Grounding
Grounding language queries in videos aims at identifying the time interval (or moment) semantically relevant to a language query. The solution to this challenging task demands understanding videos' and queries' semantic …
Graph MatchingMoment RetrievalNatural Language Moment RetrievalTemporal Localization+1A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus
Identifying a short segment in a long video that semantically matches a text query is a challenging task that has important application potentials in language-based video search, browsing, and navigation. Typical retriev…
Language ModelingLanguage ModellingMasked Language ModelingRetrieval+2Human-centric Spatio-Temporal Video Grounding With Visual Transformers
In this work, we introduce a novel task - Humancentric Spatio-Temporal Video Grounding (HC-STVG). Unlike the existing referring expression tasks in images or videos, by focusing on humans, HC-STVG aims to localize a spat…
Referring ExpressionSentenceSpatio-Temporal Video GroundingTemporal Localization+1A Data Driven End-to-end Approach for In-the-wild Monitoring of Eating Behavior Using Smartwatches
The increased worldwide prevalence of obesity has sparked the interest of the scientific community towards tools that objectively and automatically monitor eating behavior. Despite the study of obesity being in the spotl…
Temporal LocalizationReinforcement Learning for Weakly Supervised Temporal Grounding of Natural Language in Untrimmed Videos
Temporal grounding of natural language in untrimmed videos is a fundamental yet challenging multimedia task facilitating cross-media visual content retrieval. We focus on the weakly supervised setting of this task that m…
cross-modal alignmentreinforcement-learningReinforcement Learning (RL)Retrieval+1Accelerating COVID-19 Differential Diagnosis with Explainable Ultrasound Image Analysis
Controlling the COVID-19 pandemic largely hinges upon the existence of fast, safe, and highly-available diagnostic tools. Ultrasound, in contrast to CT or X-Ray, has many practical advantages and can serve as a globally-…
DiagnosticSensitivitySpecificityTemporal LocalizationText-based Localization of Moments in a Video Corpus
Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on…
Moment RetrievalRetrievalSentenceTemporal LocalizationModality Shifting Attention Network for Multi-modal Video Question Answering
This paper considers a network referred to as Modality Shifting Attention Network (MSAN) for Multimodal Video Question Answering (MVQA) task. MSAN decomposes the task into two sub-tasks: (1) localization of temporal mome…
Question AnsweringTemporal LocalizationVideo Question AnsweringVideo Moment Localization using Object Evidence and Reverse Captioning
We address the problem of language-based temporal localization of moments in untrimmed videos. Compared to temporal localization with fixed categories, this problem is more challenging as the language-based queries have …
Language-Based Temporal LocalizationLanguage ModellingObjectSemantic Segmentation+6Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA
Videos convey rich information. Dynamic spatio-temporal relationships between people/objects, and diverse multimodal events are present in a video clip. Hence, it is important to develop automated models that can accurat…
Image CaptioningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONQuestion Answering+2Action recognition in real-world videos
The goal of human action recognition is to temporally or spatially localize the human action of interest in video sequences. Temporal localization (i.e. indicating the start and end frames of the action in a video) is re…
Action RecognitionTemporal Action LocalizationTemporal LocalizationTemporal Localization of Non-Static Digital Videos Using the Electrical Network Frequency
Non-static scenes represent one of the main barriers for retrieving the electrical network frequency (ENF) from digital videos recorded in realistic scenarios, since movement influences the luminance of pixels, hindering…
ENF (Electric Network Frequency) Extraction from VideoTemporal LocalizationVideo Anomaly Detection for Smart Surveillance
In modern intelligent video surveillance systems, automatic anomaly detection through computer vision analytics plays a pivotal role which not only significantly increases monitoring efficiency but also reduces the burde…
Anomaly DetectionTemporal LocalizationVideo Anomaly DetectionInceptive Event Time-Surfaces for Object Classification Using Neuromorphic Cameras
This paper presents a novel fusion of low-level approaches for dimensionality reduction into an effective approach for high-level objects in neuromorphic camera data called Inceptive Event Time-Surfaces (IETS). IETSs ove…
ClassificationDimensionality ReductionGeneral ClassificationTemporal Localization+1Joint Visual-Temporal Embedding for Unsupervised Learning of Actions in Untrimmed Sequences
Understanding the structure of complex activities in untrimmed videos is a challenging task in the area of action recognition. One problem here is that this task usually requires a large amount of hand-annotated minute- …
Action RecognitionAction SegmentationTemporal LocalizationWeakly Supervised Temporal Action Localization Using Deep Metric Learning
Temporal action localization is an important step towards video understanding. Most current action localization methods depend on untrimmed videos with full temporal annotations of action instances. However, it is expens…
Action LocalizationMetric LearningTemporal Action LocalizationTemporal Localization+2Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action Recognition
Human activities often occur in specific scene contexts, e.g., playing basketball on a basketball court. Training a model using existing video datasets thus inevitably captures and leverages such bias (instead of using t…
Action ClassificationAction DetectionAction RecognitionGeneral Classification+2AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization
The point process is a solid framework to model sequential data, such as videos, by exploring the underlying relevance. As a challenging problem for high-level video understanding, weakly supervised action recognition an…
Action ClassificationAction RecognitionDecoderTemporal Localization+3Multi-attention Networks for Temporal Localization of Video-level Labels
Temporal localization remains an important challenge in video understanding. In this work, we present our solution to the 3rd YouTube-8M Video Understanding Challenge organized by Google Research. Participants were requi…
Action RecognitionTemporal Action LocalizationTemporal LocalizationVideo Captioning+1