Seeing the Intangible: Survey of Image Classification into High-Level and Abstract Categories
The field of Computer Vision (CV) is increasingly shifting towards ``high-level'' visual sensemaking tasks, yet the exact nature of these tasks remains unclear and tacit. This survey paper addresses this ambiguity by systematically reviewing research on high-level visual understanding, focusing particularly on Abstract Concepts (ACs) in automatic image classification. Our survey contributes in three main ways: Firstly, it clarifies the tacit understanding of high-level semantics in CV through a multidisciplinary analysis, and categorization into distinct clusters, including commonsense, emotional, aesthetic, and inductive interpretative semantics. Secondly, it identifies and categorizes computer vision tasks associated with high-level visual sensemaking, offering insights into the diverse research areas within this domain. Lastly, it examines how abstract concepts such as values and ideologies are handled in CV, revealing challenges and opportunities in AC-based image classification. Notably, our survey of AC image classification tasks highlights persistent challenges, such as the limited efficacy of massive datasets and the importance of integrating supplementary information and mid-level features. We emphasize the growing relevance of hybrid AI systems in addressing the multifaceted nature of AC image classification tasks. Overall, this survey enhances our understanding of high-level visual reasoning in CV and lays the groundwork for future research endeavors.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationClusteringimage-classificationImage ClassificationSurveyVisual ReasoningSimilar Papers 제목 키워드 기반
The National Intangible Resources and their Importance in the Current Knowledge-Based Economy
In this article, models for assessing national intangible resources are analysed through a lecture in the literature, and the best-known evaluation methods are categorized into academic models and models of international…
PositionThe Role of Intangible Investment in Predicting Stock Returns: Six Decades of Evidence
Using an intangible intensity factor that is orthogonal to the Fama--French factors, we compare the role of intangible investment in predicting stock returns over the periods 1963--1992 and 1993--2022. For 1963--1992, in…
Leveraging Model Soups to Classify Intangible Cultural Heritage Images from the Mekong Delta
The classification of Intangible Cultural Heritage (ICH) images in the Mekong Delta poses unique challenges due to limited annotated data, high visual similarity among classes, and domain heterogeneity. In such low-resou…
ICH-Qwen: A Large Language Model Towards Chinese Intangible Cultural Heritage
The intangible cultural heritage (ICH) of China, a cultural asset transmitted across generations by various ethnic groups, serves as a significant testament to the evolution of human civilization and holds irreplaceable …
Language ModelingLanguage ModellingLarge Language ModelNatural Language UnderstandingSeeing Colors: Learning Semantic Text Encoding for Classification
The question we answer with this work is: can we convert a text document into an image to exploit best image classification models to classify documents? To answer this question we present a novel text classification met…
ClassificationGeneral Classificationimage-classificationImage Classification+2