paper-with-me

Papers

The Met Dataset: Instance-level Recognition for Artworks

2022-02-03 · Nikolaos-Antonios Ypsilantis, Noa Garcia, Guangxing Han, Sarah Ibrahimi, Nanne van Noord, Giorgos Tolias

This work introduces a dataset for large-scale instance-level recognition in the domain of artworks. The proposed benchmark exhibits a number of different challenges such as large inter-class similarity, long tail distribution, and many classes. We rely on the open access collection of The Met museum to form a large training set of about 224k classes, where each class corresponds to a museum exhibit with photos taken under studio conditions. Testing is primarily performed on photos taken by museum guests depicting exhibits, which introduces a distribution shift between training and testing. Testing is additionally performed on a set of images not related to Met exhibits making the task resemble an out-of-distribution detection problem. The proposed benchmark follows the paradigm of other recent datasets for instance-level recognition on different domains to encourage research on domain independent approaches. A number of suitable approaches are evaluated to offer a testbed for future comparisons. Self-supervised and supervised contrastive learning are effectively combined to train the backbone which is used for non-parametric classification that is shown as a promising direction. Dataset webpage: http://cmp.felk.cvut.cz/met/

📄 PDF Abstract BibTeX arXiv:2202.01747

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningOut-of-Distribution Detection

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

The iMet Collection 2019 Challenge Dataset

2019-06-03 · Chenyang Zhang, Christine Kaeser-Chen, Grace Vesom, Jennie Choi 외

Existing computer vision technologies in artwork recognition focus mainly on instance retrieval or coarse-grained attribute classification. In this work, we present a novel dataset for fine-grained artwork attribute reco…

AttributeFine-Grained Visual RecognitionGeneral ClassificationRetrieval

ODOR: The ICPR2022 ODeuropa Challenge on Olfactory Object Recognition

2023-01-24 · Mathias Zinnen, Prathmesh Madhu, Ronak Kosti, Peter Bell 외

The Odeuropa Challenge on Olfactory Object Recognition aims to foster the development of object detection in the visual arts and to promote an olfactory perspective on digital heritage. Object detection in historical art…

Domain AdaptationFew-Shot LearningObjectobject-detection+2

Smelly, dense, and spreaded: The Object Detection for Olfactory References (ODOR) dataset

2025-07-11 · Mathias Zinnen, Prathmesh Madhu, Inger Leemans, Peter Bell 외 arxiv

Real-world applications of computer vision in the humanities require algorithms to be robust against artistic abstraction, peripheral objects, and subtle differences between fine-grained target classes. Existing datasets…

Object RecognitionObject Detection

Artwork Identification from Wearable Camera Images for Enhancing Experience of Museum Audiences

2018-06-24 · Rui Zhang, Yusuf Tas, Piotr Koniusz

Recommendation systems based on image recognition could prove a vital tool in enhancing the experience of museum audiences. However, for practical systems utilizing wearable cameras, a number of challenges exist which af…

Recommendation Systems

Artwork Explanation in Large-scale Vision Language Models

2024-02-29 · Kazuki Hayashi, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi 외

Large-scale vision-language models (LVLMs) output text from images and instructions, demonstrating advanced capabilities in text generation and comprehension. However, it has not been clarified to what extent LVLMs under…

Explanation GenerationImage DescriptionText Generation