Linking Art through Human Poses
We address the discovery of composition transfer in artworks based on their visual content. Automated analysis of large art collections, which are growing as a result of art digitization among museums and galleries, is an important tool for art history and assists cultural heritage preservation. Modern image retrieval systems offer good performance on visually similar artworks, but fail in the cases of more abstract composition transfer. The proposed approach links artworks through a pose similarity of human figures depicted in images. Human figures are the subject of a large fraction of visual art from middle ages to modernity and their distinctive poses were often a source of inspiration among artists. The method consists of two steps -- fast pose matching and robust spatial verification. We experimentally show that explicit human pose matching is superior to standard content-based image retrieval methods on a manually annotated art composition transfer dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Content-Based Image RetrievalImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
A Deep Metric Learning Approach to Account Linking
We consider the task of linking social media accounts that belong to the same author in an automated fashion on the basis of the content and metadata of their corresponding document streams. We focus on learning an embed…
Metric LearningCP-EB: Talking Face Generation with Controllable Pose and Eye Blinking Embedding
This paper proposes a talking face generation method named "CP-EB" that takes an audio signal as input and a person image as reference, to synthesize a photo-realistic people talking video with head poses controlled by a…
Face GenerationTalking Face GenerationMemory in humans and deep language models: Linking hypotheses for model augmentation
The computational complexity of the self-attention mechanism in Transformer models significantly limits their ability to generalize over long temporal durations. Memory-augmentation, or the explicit storing of past infor…
LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking
Entity linking (EL), the task of disambiguating mentions in text by linking them to entities in a knowledge graph, is crucial for text understanding, question answering or conversational systems. Entity linking on short …
Entity LinkingInductive BiasQuestion AnsweringSentenceSemantic Enhanced Text-to-SQL Parsing via Iteratively Learning Schema Linking Graph
The generalizability to new databases is of vital importance to Text-to-SQL systems which aim to parse human utterances into SQL statements. Existing works achieve this goal by leveraging the exact matching method to ide…
Graph LearningSQL ParsingText to SQLText-To-SQL