Video Classification using Semantic Concept Co-occurrences
We address the problem of classifying complex videos based on their content. A typical approach to this problem is performing the classification using semantic attributes, commonly termed concepts, which occur in the video. In this paper, we propose a contextual approach to video classification based on Generalized Maximum Clique Problem (GMCP) which uses the co-occurrence of concepts as the context model. To be more specific, we propose to represent a class based on the co-occurrence of its concepts and classify a video based on matching its semantic co-occurrence pattern to each class representation. We perform the matching using GMCP which finds the strongest clique of co-occurring concepts in a video. We argue that, in principal, the co-occurrence of concepts yields a richer representation of a video compared to most of the current approaches. Additionally, we propose a novel optimal solution to GMCP based on Mixed Binary Integer Programming (MBIP). The evaluations show our approach, which opens new opportunities for further research in this direction, outperforms several well established video classification methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationVideo ClassificationSimilar Papers 제목 키워드 기반
A Study on the Interplay Between the Corpus Size and Parameters of a Distributional Model for Term Classification
We propose and evaluate a method for identifying co-hyponym lexical units in a terminological resource. The principles of term recognition and distributional semantics are combined to extract terms from a similar categor…
General ClassificationTerm Based Semantic Clusters for Very Short Text Classification
Very short texts, such as tweets and invoices, present challenges in classification. Although term occurrences are strong indicators of content, in very short texts, the sparsity of these texts makes it difficult to capt…
ClassificationGeneral ClassificationSemantic SimilaritySemantic Textual Similarity+2Video Event Detection by Exploiting Word Dependencies from Image Captions
Video event detection is a challenging problem in information and multimedia retrieval. Different from single action detection, event detection requires a richer level of semantic information from video. In order to over…
Action DetectionEvent DetectionImage CaptioningRetrievalCOSTA: Co-Occurrence Statistics for Zero-Shot Classification
In this paper we aim for zero-shot classification, that is visual recognition of an unseen class by using knowledge transfer from known classes. Our main contribution is COSTA, which exploits co-occurrences of visual con…
ClassificationFew-Shot LearningGeneral ClassificationTransfer Learning+2Word-Node2Vec: Improving Word Embedding with Document-Level Non-Local Word Co-occurrences
A standard word embedding algorithm, such as word2vec and glove, makes a strong assumption that words are likely to be semantically related only if they co-occur locally within a window of fixed size. However, this stron…