Exploiting Context Information for Generic Event Boundary Captioning
Generic Event Boundary Captioning (GEBC) aims to generate three sentences describing the status change for a given time boundary. Previous methods only process the information of a single boundary at a time, which lacks utilization of video context information. To tackle this issue, we design a model that directly takes the whole video as input and generates captions for all boundaries parallelly. The model could learn the context information for each time boundary by modeling the boundary-boundary interactions. Experiments demonstrate the effectiveness of context information. The proposed method achieved a 72.84 score on the test set, and we reached the $2^{nd}$ place in this challenge. Our code is available at: \url{https://github.com/zjr2000/Context-GEBC}
Code (1)
Tasks
Boundary CaptioningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Submission to Generic Event Boundary Detection Challenge@CVPR 2022: Local Context Modeling and Global Boundary Decoding Approach
Generic event boundary detection (GEBD) is an important yet challenging task in video understanding, which aims at detecting the moments where humans naturally perceive event boundaries. In this paper, we present a local…
Boundary DetectionGeneric Event Boundary DetectionVideo UnderstandingWhat's in the Flow? Exploiting Temporal Motion Cues for Unsupervised Generic Event Boundary Detection
Generic Event Boundary Detection (GEBD) task aims to recognize generic, taxonomy-free boundaries that segment a video into meaningful events. Current methods typically involve a neural model trained on a large volume of …
Boundary DetectionGeneric Event Boundary DetectionOptical Flow EstimationStructured Context Transformer for Generic Event Boundary Detection
Generic Event Boundary Detection (GEBD) aims to detect moments where humans naturally perceive as event boundaries. In this paper, we present Structured Context Transformer (or SC-Transformer) to solve the GEBD task, whi…
Boundary DetectionGeneric Event Boundary DetectionStructured Context Learning for Generic Event Boundary Detection
Generic Event Boundary Detection (GEBD) aims to identify moments in videos that humans perceive as event boundaries. This paper proposes a novel method for addressing this task, called Structured Context Learning, which …
Generic Event Boundary DetectionSC-Transformer++: Structured Context Transformer for Generic Event Boundary Detection
This report presents the algorithm used in the submission of Generic Event Boundary Detection (GEBD) Challenge at CVPR 2022. In this work, we improve the existing Structured Context Transformer (SC-Transformer) method fo…
Boundary DetectionDecoderGeneric Event Boundary DetectionOptical Flow Estimation