Winning the CVPR'2021 Kinetics-GEBD Challenge: Contrastive Learning Approach
Generic Event Boundary Detection (GEBD) is a newly introduced task that aims to detect "general" event boundaries that correspond to natural human perception. In this paper, we introduce a novel contrastive learning based approach to deal with the GEBD. Our intuition is that the feature similarity of the video snippet would significantly vary near the event boundaries, while remaining relatively the same in the remaining part of the video. In our model, Temporal Self-similarity Matrix (TSM) is utilized as an intermediate representation which takes on a role as an information bottleneck. With our model, we achieved significant performance boost compared to the given baselines. Our code is available at https://github.com/hello-jinwoo/LOVEU-CVPR2021.
Code (1)
Tasks
Boundary DetectionContrastive LearningGeneric Event Boundary DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MAE-GEBD:Winning the CVPR'2023 LOVEU-GEBD Challenge
The Generic Event Boundary Detection (GEBD) task aims to build a model for segmenting videos into segments by detecting general event boundaries applicable to various classes. In this paper, based on last year's MAE-GEBD…
Boundary DetectionGeneric Event Boundary DetectionPseudo LabelSegmentationMasked Autoencoders for Generic Event Boundary Detection CVPR'2022 Kinetics-GEBD Challenge
Generic Event Boundary Detection (GEBD) tasks aim at detecting generic, taxonomy-free event boundaries that segment a whole video into chunks. In this paper, we apply Masked Autoencoders to improve algorithm performance …
Boundary DetectionGeneric Event Boundary DetectionPseudo LabelGeneric Event Boundary Detection: A Benchmark for Event Segmentation
This paper presents a novel task together with a new benchmark for detecting generic, taxonomy-free event boundaries that segment a whole video into chunks. Conventional work in temporal video segmentation and action det…
Action DetectionBoundary DetectionEvent SegmentationGeneric Event Boundary Detection+2Submission to Generic Event Boundary Detection Challenge@CVPR 2022: Local Context Modeling and Global Boundary Decoding Approach
Generic event boundary detection (GEBD) is an important yet challenging task in video understanding, which aims at detecting the moments where humans naturally perceive event boundaries. In this paper, we present a local…
Boundary DetectionGeneric Event Boundary DetectionVideo UnderstandingGeneric Event Boundary Detection Challenge at CVPR 2021 Technical Report: Cascaded Temporal Attention Network (CASTANET)
This report presents the approach used in the submission of Generic Event Boundary Detection (GEBD) Challenge at CVPR21. In this work, we design a Cascaded Temporal Attention Network (CASTANET) for GEBD, which is formed …
Boundary DetectionEvent SegmentationGeneric Event Boundary Detection