Bridging the Gap between Semantics and Multimedia Processing
In this paper, we give an overview of the semantic gap problem in multimedia and discuss how machine learning and symbolic AI can be combined to narrow this gap. We describe the gap in terms of a classical architecture for multimedia processing and discuss a structured approach to bridge it. This approach combines machine learning (for mapping signals to objects) and symbolic AI (for linking objects to meanings). Our main goal is to raise awareness and discuss the challenges involved in this structured approach to multimedia understanding, especially in the view of the latest developments in machine learning and symbolic AI.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Towards Bridging the Cross-modal Semantic Gap for Multi-modal Recommendation
Multi-modal recommendation greatly enhances the performance of recommender systems by modeling the auxiliary information from multi-modality contents. Most existing multi-modal recommendation models primarily exploit mul…
cross-modal alignmentMulti-modal RecommendationRecommendation SystemsSemantic Similarity+1STIMONT: A core ontology for multimedia stimuli description
Affective multimedia documents such as images, sounds or videos elicit emotional responses in exposed human subjects. These stimuli are stored in affective multimedia databases and successfully used for a wide variety of…
RetrievalA Survey of Multimedia Technologies and Robust Algorithms
Multimedia technologies are now more practical and deployable in real life, and the algorithms are widely used in various researching areas such as deep learning, signal processing, haptics, computer vision, robotics, an…
SurveyLecEval: An Automated Metric for Multimodal Knowledge Acquisition in Multimedia Learning
Evaluating the quality of slide-based multimedia instruction is challenging. Existing methods like manual assessment, reference-based metrics, and large language model evaluators face limitations in scalability, context …
Language ModelingLanguage ModellingLarge Language Model