paper-with-me

홈 › Papers

Video Region Annotation with Sparse Bounding Boxes

2020-08-17 · Yuzheng Xu, Yang Wu, Nur Sabrina binti Zuraimi, Shohei Nobuhara, Ko Nishino

Video analysis has been moving towards more detailed interpretation (e.g. segmentation) with encouraging progresses. These tasks, however, increasingly rely on densely annotated training data both in space and time. Since such annotation is labour-intensive, few densely annotated video data with detailed region boundaries exist. This work aims to resolve this dilemma by learning to automatically generate region boundaries for all frames of a video from sparsely annotated bounding boxes of target regions. We achieve this with a Volumetric Graph Convolutional Network (VGCN), which learns to iteratively find keypoints on the region boundaries using the spatio-temporal volume of surrounding appearance and motion. The global optimization of VGCN makes it significantly stronger and generalize better than existing solutions. Experimental results using two latest datasets (one real and one synthetic), including ablation studies, demonstrate the effectiveness and superiority of our method.

📄 PDF Abstract BibTeX arXiv:2008.07049

Code (0)

등록된 구현이 없습니다.

Tasks

global-optimization

Methods 이 논문이 사용한 방법론

GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Track and Transfer: Watching Videos to Simulate Strong Human Supervision for Weakly-Supervised Object Detection

2016-04-19 · CVPR 2016 6 · Krishna Kumar Singh, Fanyi Xiao, Yong Jae Lee

The status quo approach to training object detectors requires expensive bounding box annotations. Our framework takes a markedly different direction: we transfer tracked object boxes from weakly-labeled videos to weakly-…

Objectobject-detectionObject DetectionWeakly Supervised Object Detection

Efficient video annotation with visual interpolation and frame selection guidance

2020-12-23 · A. Kuznetsova, A. Talati, Y. Luo, K. Simmons 외

We introduce a unified framework for generic video annotation with bounding boxes. Video annotation is a longstanding problem, as it is a tedious and time-consuming process. We tackle two important challenges of video an…

Pointly-Supervised Action Localization

2018-05-29 · Pascal Mettes, Cees G. M. Snoek

This paper strives for spatio-temporal localization of human actions in videos. In the literature, the consensus is to achieve localization by training on bounding box annotations provided for each frame of each training…

Action LocalizationMultiple Instance LearningTemporal Localization

YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video

2017-02-02 · CVPR 2017 7 · Esteban Real, Jonathon Shlens, Stefano Mazzocchi, Xin Pan 외

We introduce a new large-scale data set of video URLs with densely-sampled object bounding box annotations called YouTube-BoundingBoxes (YT-BB). The data set consists of approximately 380,000 video segments about 19s lon…

General Classificationobject-detectionObject DetectionVideo Object Detection

End-to-End Spatio-Temporal Action Localisation with Video Transformers

2023-04-24 · CVPR 2024 1 · Alexey Gritsenko, Xuehan Xiong, Josip Djolonga, Mostafa Dehghani 외

The most performant spatio-temporal action localisation models use external person proposals and complex external memory banks. We propose a fully end-to-end, purely-transformer based model that directly ingests an input…

Action DetectionAction RecognitionSpatio-Temporal Action Localization