Understanding Art through Multi-Modal Retrieval in Paintings
In computer vision, visual arts are often studied from a purely aesthetics perspective, mostly by analysing the visual appearance of an artistic reproduction to infer its style, its author, or its representative features. In this work, however, we explore art from both a visual and a language perspective. Our aim is to bridge the gap between the visual appearance of an artwork and its underlying meaning, by jointly analysing its aesthetics and its semantics. We introduce the use of multi-modal techniques in the field of automatic art analysis by 1) collecting a multi-modal dataset with fine-art paintings and comments, and 2) exploring robust visual and textual representations in artistic images.
Code (0)
등록된 구현이 없습니다.
Tasks
Art AnalysisRetrievalSimilar Papers 제목 키워드 기반
How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrieval
Automatic art analysis has been mostly focused on classifying artworks into different artistic styles. However, understanding an artistic representation involves more complex processes, such as identifying the elements i…
Art AnalysisRetrievalIntegrating Visual and X-Ray Machine Learning Features in the Study of Paintings by Goya
Art authentication of Francisco Goya's works presents complex computational challenges due to his heterogeneous stylistic evolution and extensive historical patterns of forgery. We introduce a novel multimodal machine le…
Abstract4D: A Large-Scale Dataset and Framework for Understanding the Visual Language of Abstract Art
Artificial intelligence can classify artistic styles and synthesize images, but it still lacks a model of the visual language that gives art meaning. Abstract painting minimizes object semantics and foregrounds structura…
Text-to-Image GenerationCross-Modal RetrievalA Multi-modal Registration and Visualization Software Tool for Artworks using CraquelureNet
For art investigations of paintings, multiple imaging technologies, such as visual light photography, infrared reflectography, ultraviolet fluorescence photography, and x-radiography are often used. For a pixel-wise comp…
Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learning
Human pose estimation (HPE) is a central part of understanding the visual narration and body movements of characters depicted in artwork collections, such as Greek vase paintings. Unfortunately, existing HPE methods do n…
Image RetrievalPose EstimationRetrievalStyle Transfer+1