Training-Time-Friendly Network for Real-Time Object Detection
Modern object detectors can rarely achieve short training time, fast inference speed, and high accuracy at the same time. To strike a balance among them, we propose the Training-Time-Friendly Network (TTFNet). In this work, we start with light-head, single-stage, and anchor-free designs, which enable fast inference speed. Then, we focus on shortening training time. We notice that encoding more training samples from annotated boxes plays a similar role as increasing batch size, which helps enlarge the learning rate and accelerate the training process. To this end, we introduce a novel approach using Gaussian kernels to encode training samples. Besides, we design the initiative sample weights for better information utilization. Experiments on MS COCO show that our TTFNet has great advantages in balancing training time, inference speed, and accuracy. It has reduced training time by more than seven times compared to previous real-time detectors while maintaining state-of-the-art performances. In addition, our super-fast version of TTFNet-18 and TTFNet-53 can outperform SSD300 and YOLOv3 by less than one-tenth of their training time, respectively. The code has been made available at \url{https://github.com/ZJULearning/ttfnet}.
Code (6)
Tasks
Objectobject-detectionObject DetectionReal-Time Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Evolutionary Multi-objective Optimization of Real-Time Strategy Micro
We investigate an evolutionary multi-objective approach to good micro for real-time strategy games. Good micro helps a player win skirmishes and is one of the keys to developing better real-time strategy game play. In pr…
Real-Time Strategy GamesIncorporating Test-Time Optimization into Training with Dual Networks for Human Mesh Recovery
Human Mesh Recovery (HMR) is the task of estimating a parameterized 3D human mesh from an image. There is a kind of methods first training a regression model for this problem, then further optimizing the pretrained regre…
Human Mesh RecoveryMeta-LearningregressionOVLW-DETR: Open-Vocabulary Light-Weighted Detection Transformer
Open-vocabulary object detection focusing on detecting novel categories guided by natural language. In this report, we propose Open-Vocabulary Light-Weighted Detection Transformer (OVLW-DETR), a deployment friendly open-…
Language ModelingLanguage Modellingobject-detectionObject Detection+2TensorFlow with user friendly Graphical Framework for object detection API
TensorFlow is an open-source framework for deep learning dataflow and contains application programming interfaces (APIs) of voice analysis, natural language process, and computer vision. Especially, TensorFlow object det…
Deep LearningModel Selectionobject-detectionObject DetectionDecoderTracker: Decoder-Only Method for Multiple-Object Tracking
Decoder-only models, such as GPT, have demonstrated superior performance in many areas compared to traditional encoder-decoder structure transformer models. Over the years, end-to-end models based on the traditional tran…
DecoderMulti-Object TrackingMultiple Object TrackingObject+3