paper-with-me

홈 › Papers

T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

2016-04-09 · Kai Kang, Hongsheng Li, Junjie Yan, Xingyu Zeng, Bin Yang, Tong Xiao, Cong Zhang, Zhe Wang, Ruohui Wang, Xiaogang Wang, Wanli Ouyang

The state-of-the-art performance for object detection has been significantly improved over the past two years. Besides the introduction of powerful deep neural networks such as GoogleNet and VGG, novel object detection frameworks such as R-CNN and its successors, Fast R-CNN and Faster R-CNN, play an essential role in improving the state-of-the-art. Despite their effectiveness on still images, those frameworks are not specifically designed for object detection from videos. Temporal and contextual information of videos are not fully investigated and utilized. In this work, we propose a deep learning framework that incorporates temporal and contextual information from tubelets obtained in videos, which dramatically improves the baseline performance of existing still-image detection frameworks when they are applied to videos. It is called T-CNN, i.e. tubelets with convolutional neueral networks. The proposed framework won the recently introduced object-detection-from-video (VID) task with provided data in the ImageNet Large-Scale Visual Recognition Challenge 2015 (ILSVRC2015).

📄 PDF Abstract BibTeX arXiv:1604.02532

Code (1)

myfavouritekk/T-CNN 공식 구현

Tasks

Novel Object DetectionObjectobject-detectionObject DetectionObject Recognition

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Ethereum Customer Service Number +1-833-534-1729 설명 없음
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…
Average Pooling 설명 없음
Local Response Normalization Local Response Normalization is a normalization layer that implements the idea of lateral inhibition. Lateral inhibition is a concept in neurobiology that refers to the…
Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…
Inception Module An Inception Module is an image model block that aims to approximate an optimal local sparse structure in a CNN. Put simply, it allows for us to use multiple types of filter…

Similar Papers 제목 키워드 기반

Object Detection in Videos with Tubelet Proposal Networks

2017-02-21 · CVPR 2017 7 · Kai Kang, Hongsheng Li, Tong Xiao, Wanli Ouyang 외

Object detection in videos has drawn increasing attention recently with the introduction of the large-scale ImageNet VID dataset. Different from object detection in static images, temporal information in videos is vital …

Objectobject-detectionObject DetectionObject Tracking

Object Detection in Videos by High Quality Object Linking

2018-01-30 · Peng Tang, Chunyu Wang, Xinggang Wang, Wenyu Liu 외

Compared with object detection in static images, object detection in videos is more challenging due to degraded image qualities. An effective way to address this problem is to exploit temporal contexts by linking the sam…

General ClassificationObjectobject-detectionObject Detection+1

Object Detection in Videos by Short and Long Range Object Linking

2018-01-30 · IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAM) 2018 1 · Peng Tang † Chunyu Wang ‡ Xinggang Wang † Wenyu Liu † Wenjun Zeng ‡ Jingdong Wang ‡ † School of EIC, Huazhong University of Science and Technology   ‡ Microsoft Research Asia

We address the problem of detecting objects in videos with the interest in exploring temporal contexts. Our core idea is to link objects in the short and long ranges for improving the classification quality. Our approach…

ClassificationObjectobject-detectionObject Detection

In Defense of Clip-based Video Relation Detection

2023-07-18 · Meng Wei, Long Chen, Wei Ji, Xiaoyu Yue 외

Video Visual Relation Detection (VidVRD) aims to detect visual relationship triplets in videos using spatial bounding boxes and temporal boundaries. Existing VidVRD methods can be broadly categorized into bottom-up and t…

Feature CompressionObject TrackingRelationVideo Visual Relation Detection

Tubelets: Unsupervised action proposals from spatiotemporal super-voxels

2016-07-07 · Mihir Jain, Jan van Gemert, Hervé Jégou, Patrick Bouthemy 외

This paper considers the problem of localizing actions in videos as a sequences of bounding boxes. The objective is to generate action proposals that are likely to include the action of interest, ideally achieving high r…

Action Localization