Museum Exhibit Identification Challenge for Domain Adaptation and Beyond
In this paper, we approach an open problem of artwork identification and propose a new dataset dubbed Open Museum Identification Challenge (Open MIC). It contains photos of exhibits captured in 10 distinct exhibition spaces of several museums which showcase paintings, timepieces, sculptures, glassware, relics, science exhibits, natural history pieces, ceramics, pottery, tools and indigenous crafts. The goal of Open MIC is to stimulate research in domain adaptation, egocentric recognition and few-shot learning by providing a testbed complementary to the famous Office dataset which reaches 90% accuracy. To form our dataset, we captured a number of images per art piece with a mobile phone and wearable cameras to form the source and target data splits, respectively. To achieve robust baselines, we build on a recent approach that aligns per-class scatter matrices of the source and target CNN streams [15]. Moreover, we exploit the positive definite nature of such representations by using end-to-end Bregman divergences and the Riemannian metric. We present baselines such as training/evaluation per exhibition and training/evaluation on the combined set covering 866 exhibit identities. As each exhibition poses distinct challenges e.g., quality of lighting, motion blur, occlusions, clutter, viewpoint and scale variations, rotations, glares, transparency, non-planarity, clipping, we break down results w.r.t. these factors.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationFew-Shot LearningSimilar Papers 제목 키워드 기반
Museum Exhibit Identification Challenge for the Supervised Domain Adaptation and Beyond
We study an open problem of artwork identification and propose a new dataset dubbed Open Museum Identification Challenge (Open MIC). It contains photos of exhibits captured in 10 distinct exhibition spaces of several mus…
Domain AdaptationFew-Shot LearningArtwork Identification from Wearable Camera Images for Enhancing Experience of Museum Audiences
Recommendation systems based on image recognition could prove a vital tool in enhancing the experience of museum audiences. However, for practical systems utilizing wearable cameras, a number of challenges exist which af…
Recommendation Systems3D Reconstruction of Sculptures from Single Images via Unsupervised Domain Adaptation on Implicit Models
Acquiring the virtual equivalent of exhibits, such as sculptures, in virtual reality (VR) museums, can be labour-intensive and sometimes infeasible. Deep learning based 3D reconstruction approaches allow us to recover 3D…
3D ReconstructionDomain AdaptationUnsupervised Domain AdaptationThe Met Dataset: Instance-level Recognition for Artworks
This work introduces a dataset for large-scale instance-level recognition in the domain of artworks. The proposed benchmark exhibits a number of different challenges such as large inter-class similarity, long tail distri…
Contrastive LearningOut-of-Distribution DetectionNext-Gen Museum Guides: Autonomous Navigation and Visitor Interaction with an Agentic Robot
Autonomous robots are increasingly being tested into public spaces to enhance user experiences, particularly in cultural and educational settings. This paper presents the design, implementation, and evaluation of the aut…