Multilevel profiling of situation and dialogue-based deep networks for movie genre classification using movie trailers
Automated movie genre classification has emerged as an active and essential area of research and exploration. Short duration movie trailers provide useful insights about the movie as video content consists of the cognitive and the affective level features. Previous approaches were focused upon either cognitive or affective content analysis. In this paper, we propose a novel multi-modality: situation, dialogue, and metadata-based movie genre classification framework that takes both cognition and affect-based features into consideration. A pre-features fusion-based framework that takes into account: situation-based features from a regular snapshot of a trailer that includes nouns and verbs providing the useful affect-based mapping with the corresponding genres, dialogue (speech) based feature from audio, metadata which together provides the relevant information for cognitive and affect based video analysis. We also develop the English movie trailer dataset (EMTD), which contains 2000 Hollywood movie trailers belonging to five popular genres: Action, Romance, Comedy, Horror, and Science Fiction, and perform cross-validation on the standard LMTD-9 dataset for validating the proposed framework. The results demonstrate that the proposed methodology for movie genre classification has performed excellently as depicted by the F1 scores, precision, recall, and area under the precision-recall curves.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGenre classificationSimilar Papers 제목 키워드 기반
Longitudinal Abuse and Sentiment Analysis of Hollywood Movie Dialogues using LLMs
Over the past decades, there has been an increasing concern about the prevalence of abusive and violent content in Hollywood movies. This study uses Large Language Models (LLMs) to explore the longitudinal abuse and sent…
Sentiment AnalysisTowards Evaluating User Profiling Methods Based on Explicit Ratings on Item Features
In order to improve the accuracy of recommendations, many recommender systems nowadays use side information beyond the user rating matrix, such as item content. These systems build user profiles as estimates of users' in…
Recommendation SystemsSequential Movie Genre Prediction using Average Transition Probability with Clustering
In recent movie recommendations, predicting the user's sequential behavior and suggesting the next movie to watch is one of the most important issues. However, capturing such sequential behavior is not easy because each …
ClusteringSequential RecommendationA movie genre prediction based on Multivariate Bernoulli model and genre correlations
Movie ratings play an important role both in determining the likelihood of a potential viewer to watch the movie and in reflecting the current viewer satisfaction with the movie. They are available in several sources lik…
Age Suitability Rating: Predicting the MPAA Rating Based on Movie Dialogues
Movies help us learn and inspire societal change. But they can also contain objectionable content that negatively affects viewers{'} behaviour, especially children. In this paper, our goal is to predict the suitability o…