Rethinking movie genre classification with fine-grained semantic clustering
Movie genre classification is an active research area in machine learning. However, due to the limited labels available, there can be large semantic variations between movies within a single genre definition. We expand these 'coarse' genre labels by identifying 'fine-grained' semantic information within the multi-modal content of movies. By leveraging pre-trained 'expert' networks, we learn the influence of different combinations of modes for multi-label genre classification. Using a contrastive loss, we continue to fine-tune this 'coarse' genre classification network to identify high-level intertextual similarities between the movies across all genre labels. This leads to a more 'fine-grained' and detailed clustering, based on semantic similarities while still retaining some genre information. Our approach is demonstrated on a newly introduced multi-modal 37,866,450 frame, 8,800 movie trailer dataset, MMX-Trailer-20, which includes pre-computed audio, location, motion, and image embeddings.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationClusteringGeneral ClassificationGenre classificationSimilar Papers 제목 키워드 기반
Demystifying ChatGPT: How It Masters Genre Recognition
The introduction of ChatGPT has garnered significant attention within the NLP community and beyond. Previous studies have demonstrated ChatGPT's substantial advancements across various downstream NLP tasks, highlighting …
Movie Genre Classification by Language Augmentation and Shot Sampling
Video-based movie genre classification has garnered considerable attention due to its various applications in recommendation systems. Prior work has typically addressed this task by adapting models from traditional video…
Action RecognitionBoundary DetectionClassificationEvent Detection+4Unraveling Movie Genres through Cross-Attention Fusion of Bi-Modal Synergy of Poster
Movie posters are not just decorative; they are meticulously designed to capture the essence of a movie, such as its genre, storyline, and tone/vibe. For decades, movie posters have graced cinema walls, billboards, and n…
Genre classificationMarketingOptical Character Recognition (OCR)Recommendation SystemsMultilevel profiling of situation and dialogue-based deep networks for movie genre classification using movie trailers
Automated movie genre classification has emerged as an active and essential area of research and exploration. Short duration movie trailers provide useful insights about the movie as video content consists of the cogniti…
ClassificationGenre classificationUtilizing Imbalanced Data and Classification Cost Matrix to Predict Movie Preferences
In this paper, we propose a movie genre recommendation system based on imbalanced survey data and unequal classification costs for small and medium-sized enterprises (SMEs) who need a data-based and analytical approach t…
ClassificationGeneral ClassificationMarketingMovie Genre Recommendation System+1