Exploiting Spatial-Temporal Semantic Consistency for Video Scene Parsing
Compared with image scene parsing, video scene parsing introduces temporal information, which can effectively improve the consistency and accuracy of prediction. In this paper, we propose a Spatial-Temporal Semantic Consistency method to capture class-exclusive context information. Specifically, we design a spatial-temporal consistency loss to constrain the semantic consistency in spatial and temporal dimensions. In addition, we adopt an pseudo-labeling strategy to enrich the training dataset. We obtain the scores of 59.84% and 58.85% mIoU on development (test part 1) and testing set of VSPW, respectively. And our method wins the 1st place on VSPW challenge at ICCV2021.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene ParsingSimilar Papers 제목 키워드 기반
Exploiting temporal consistency for real-time video depth estimation
Accuracy of depth estimation from static images has been significantly improved recently, by exploiting hierarchical features from deep convolutional neural networks (CNNs). Compared with static images, vast information …
Depth EstimationMonocular Depth EstimationSpatiotemporal Inconsistency Learning for DeepFake Video Detection
The rapid development of facial manipulation techniques has aroused public concerns in recent years. Following the success of deep learning, existing methods always formulate DeepFake video detection as a binary classifi…
Binary ClassificationFace SwappingRegion-Based Multiscale Spatiotemporal Saliency for Video
Detecting salient objects from a video requires exploiting both spatial and temporal knowledge included in the video. We propose a novel region-based multiscale spatiotemporal saliency detection method for videos, where …
Saliency DetectionSST-EM: Advanced Metrics for Evaluating Semantic, Spatial and Temporal Aspects in Video Editing
Video editing models have advanced significantly, but evaluating their performance remains challenging. Traditional metrics, such as CLIP text and image scores, often fall short: text scores are limited by inadequate tra…
Objectobject-detectionObject DetectionObject Tracking+1Unsupervised Coherent Video Cartoonization with Perceptual Motion Consistency
In recent years, creative content generations like style transfer and neural photo editing have attracted more and more attention. Among these, cartoonization of real-world scenes has promising applications in entertainm…
DecoderOptical Flow EstimationStyle Transfer