Can Deep Learning Assist Automatic Identification of Layered Pigments From XRF Data?
X-ray fluorescence spectroscopy (XRF) plays an important role for elemental analysis in a wide range of scientific fields, especially in cultural heritage. XRF imaging, which uses a raster scan to acquire spectra across artworks, provides the opportunity for spatial analysis of pigment distributions based on their elemental composition. However, conventional XRF-based pigment identification relies on time-consuming elemental mapping by expert interpretations of measured spectra. To reduce the reliance on manual work, recent studies have applied machine learning techniques to cluster similar XRF spectra in data analysis and to identify the most likely pigments. Nevertheless, it is still challenging for automatic pigment identification strategies to directly tackle the complex structure of real paintings, e.g. pigment mixtures and layered pigments. In addition, pixel-wise pigment identification based on XRF imaging remains an obstacle due to the high noise level compared with averaged spectra. Therefore, we developed a deep-learning-based end-to-end pigment identification framework to fully automate the pigment identification process. In particular, it offers high sensitivity to the underlying pigments and to the pigments with a low concentration, therefore enabling satisfying results in mapping the pigments based on single-pixel XRF spectrum. As case studies, we applied our framework to lab-prepared mock-up paintings and two 19th-century paintings: Paul Gauguin's Po\`emes Barbares (1896) that contains layered pigments with an underlying painting, and Paul Cezanne's The Bathers (1899-1904). The pigment identification results demonstrated that our model achieved comparable results to the analysis by elemental mapping, suggesting the generalizability and stability of our model.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Prediction Model for Semitransparent Watercolor Pigment Mixtures Using Deep Learning with a Dataset of Transmittance and Reflectance
Learning color mixing is difficult for novice painters. In order to support novice painters in learning color mixing, we propose a prediction model for semitransparent pigment mixtures and use its prediction results to c…
Image Enhancement Based on Pigment Representation
This paper presents a novel and efficient image enhancement method based on pigment representation. Unlike conventional methods where the color transformation is restricted to pre-defined color spaces like RGB, our metho…
Image EnhancementComment on Activation of Visual Pigments by Light and Heat (Science 332, 1307-312, 2011)
It is known that the Arrhenius equation, based on the Boltzmann distribution, can model only a part (e.g. half of the activation energy) for retinal discrete dark noise observed for vertebrate rod and cone pigments. Luo …
Radiometric Calibration From Faces in Images
We present a method for radiometric calibration of cameras from a single image that contains a human face. This technique takes advantage of a low-rank property that exists among certain skin albedo gradients because of …
The minimal model of light harvesting complex with dipole-quadrupole interaction derived from ab initio calculation
A minimal, one-parameter model of the excitonic Hamiltonian for the light harvesting complex of purple bacteria (LH2) based on ab initio calculation of the excitonic energies is proposed. The set of input parameters cont…