paper-with-me

Papers

Deep transfer learning for visual analysis and attribution of paintings by Raphael

2023-12-20 · Heritage Science 2023 12 · Hassan Ugail, David G. Stork, Howell Edwards, Steven C. Seward, Christopher Brooke

Visual analysis and authentication of artworks are challenging tasks central to art history and criticism. This preliminary study presents a computational tool for scholars examining and authenticating a restricted class of paintings, with a specific focus on the paintings of Raffaello Sanzio da Urbino, more popularly known as Raphael. We applied transfer learning to the ResNet50 deep neural network for feature extraction and used a support vector machine (SVM) binary classifier in support of authentication. Edge detection and analysis algorithms, considered to be crucial for capturing the essence of Raphael’s artistic style, including the brushwork signatures, were also integrated and are used as an authentication tool. The machine learning approach we have developed demonstrates an accuracy of 98% in image-based classification tasks during validation using a test set of well known and authentic paintings by Raphael. Of course, a full authentication protocol relies on provenance, history, material studies, iconography, studies of a work’s condition, and more. Our work, then, contributes to just a portion of a full authentication protocol. Our findings suggest that machine learning methods, properly employed by experts aware of context, may enhance and expand traditional visual analysis for problems in art authentication.

📄 PDF Abstract BibTeX

Code (1)

ugail/RaphaelHeritageSciencePaper

Tasks

Edge DetectionTransfer Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Discerning the painter's hand: machine learning on surface topography

2021-06-14 · F. Ji, M. S. McMaster, S. Schwab, G. Singh 외

Attribution of paintings is a critical problem in art history. This study extends machine learning analysis to surface topography of painted works. A controlled study of positive attribution was designed with paintings p…

BIG-bench Machine Learning

Analysis of Dutch Master Paintings with Convolutional Neural Networks

2020-02-12 · Steven J. Frank, Andrea M. Frank

Trained on the works of an artist under study and visually comparable works of other artists, convolutional neural networks can identify forgeries and provide attributions. They can also assign classification probabiliti…

General Classification

A Neural Network Looks at Leonardo's(?) Salvator Mundi

2020-05-21 · Steven J. Frank, Andrea M. Frank

We use convolutional neural networks (CNNs) to analyze authorship questions surrounding the works of Leonardo da Vinci -- in particular, Salvator Mundi, the world's most expensive painting and among the most controversia…

Recovery of underdrawings and ghost-paintings via style transfer by deep convolutional neural networks: A digital tool for art scholars

2021-01-04 · Anthony Bourached, George Cann, Ryan-Rhys Griffiths, David G. Stork

We describe the application of convolutional neural network style transfer to the problem of improved visualization of underdrawings and ghost-paintings in fine art oil paintings. Such underdrawings and hidden paintings …

Art AnalysisStyle Transfer

Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learning

2020-12-10 · Prathmesh Madhu, Angel Villar-Corrales, Ronak Kosti, Torsten Bendschus 외

Human pose estimation (HPE) is a central part of understanding the visual narration and body movements of characters depicted in artwork collections, such as Greek vase paintings. Unfortunately, existing HPE methods do n…

Image RetrievalPose EstimationRetrievalStyle Transfer+1