FusedLSTM: Fusing frame-level and video-level features for Content-based Video Relevance Prediction
This paper describes two of my best performing approaches on the Content-based Video Relevance Prediction challenge. In the FusedLSTM based approach, the inception-pool3 and the C3D-pool5 features are combined using an LSTM and a dense layer to form embeddings with the objective to minimize the triplet loss function. In the second approach, an Online Kernel Similarity Learning method is proposed to learn a non-linear similarity measure to adhere the relevance training data. The last section gives a complete comparison of all the approaches implemented during this challenge, including the one presented in the baseline paper.
Code (0)
등록된 구현이 없습니다.
Tasks
TripletSimilar Papers 제목 키워드 기반
Learnable Sampling 3D Convolution for Video Enhancement and Action Recognition
A key challenge in video enhancement and action recognition is to fuse useful information from neighboring frames. Recent works suggest establishing accurate correspondences between neighboring frames before fusing tempo…
Action RecognitionDenoisingSuper-ResolutionVideo Denoising+2Non-Volume Preserving-based Fusion to Group-Level Emotion Recognition on Crowd Videos
Group-level emotion recognition (ER) is a growing research area as the demands for assessing crowds of all sizes are becoming an interest in both the security arena as well as social media. This work extends the earlier …
Emotion RecognitionvireoJD-MM at Activity Detection in Extended Videos
This notebook paper presents an overview and comparative analysis of our system designed for activity detection in extended videos (ActEV-PC) in ActivityNet Challenge 2019. Specifically, we exploit person/vehicle detecti…
Action DetectionAction LocalizationActivity DetectionVideo Captioning with Boundary-aware Hierarchical Language Decoding and Joint Video Prediction
The explosion of video data on the internet requires effective and efficient technology to generate captions automatically for people who are not able to watch the videos. Despite the great progress of video captioning r…
DecoderLanguage ModelingLanguage ModellingSentence+3SMILE: Infusing Spatial and Motion Semantics in Masked Video Learning
Masked video modeling, such as VideoMAE, is an effective paradigm for video self-supervised learning (SSL). However, they are primarily based on reconstructing pixel-level details on natural videos which have substantial…
Representation LearningSelf-Supervised Learning