Constrained-size Tensorflow Models for YouTube-8M Video Understanding Challenge
This paper presents our 7th place solution to the second YouTube-8M video understanding competition which challenges participates to build a constrained-size model to classify millions of YouTube videos into thousands of classes. Our final model consists of four single models aggregated into one tensorflow graph. For each single model, we use the same network architecture as in the winning solution of the first YouTube-8M video understanding competition, namely Gated NetVLAD. We train the single models separately in tensorflow's default float32 precision, then replace weights with float16 precision and ensemble them in the evaluation and inference stages., achieving 48.5% compression rate without loss of precision. Our best model achieved 88.324% GAP on private leaderboard. The code is publicly available at https://github.com/boliu61/youtube-8m
Code (2)
Tasks
Video UnderstandingSimilar Papers 제목 키워드 기반
YouTube-8M: A Large-Scale Video Classification Benchmark
Many recent advancements in Computer Vision are attributed to large datasets. Open-source software packages for Machine Learning and inexpensive commodity hardware have reduced the barrier of entry for exploring novel ap…
3D Face ReconstructionAction RecognitionAction Recognition In VideosGeneral Classification+1An Effective Way to Improve YouTube-8M Classification Accuracy in Google Cloud Platform
Large-scale datasets have played a significant role in progress of neural network and deep learning areas. YouTube-8M is such a benchmark dataset for general multi-label video classification. It was created from over 7 m…
ClassificationDeep LearningGeneral ClassificationVideo Classification+1Analyzing Political Figures in Real-Time: Leveraging YouTube Metadata for Sentiment Analysis
Sentiment analysis using big data from YouTube videos metadata can be conducted to analyze public opinions on various political figures who represent political parties. This is possible because YouTube has become one of …
Sentiment AnalysisVideo DescriptionYouTube for Patient Education: A Deep Learning Approach for Understanding Medical Knowledge from User-Generated Videos
YouTube presents an unprecedented opportunity to explore how machine learning methods can improve healthcare information dissemination. We propose an interdisciplinary lens that synthesizes machine learning methods with …
BIG-bench Machine LearningDeep LearningGeneral Classificationimage-classification+2Face2Face: Real-time Face Capture and Reenactment of RGB Videos
We present Face2Face, a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity web…