paper-with-me

Papers

Human Saliency-Driven Patch-based Matching for Interpretable Post-mortem Iris Recognition

2022-08-03 · Aidan Boyd, Daniel Moreira, Andrey Kuehlkamp, Kevin Bowyer, Adam Czajka

Forensic iris recognition, as opposed to live iris recognition, is an emerging research area that leverages the discriminative power of iris biometrics to aid human examiners in their efforts to identify deceased persons. As a machine learning-based technique in a predominantly human-controlled task, forensic recognition serves as "back-up" to human expertise in the task of post-mortem identification. As such, the machine learning model must be (a) interpretable, and (b) post-mortem-specific, to account for changes in decaying eye tissue. In this work, we propose a method that satisfies both requirements, and that approaches the creation of a post-mortem-specific feature extractor in a novel way employing human perception. We first train a deep learning-based feature detector on post-mortem iris images, using annotations of image regions highlighted by humans as salient for their decision making. In effect, the method learns interpretable features directly from humans, rather than purely data-driven features. Second, regional iris codes (again, with human-driven filtering kernels) are used to pair detected iris patches, which are translated into pairwise, patch-based comparison scores. In this way, our method presents human examiners with human-understandable visual cues in order to justify the identification decision and corresponding confidence score. When tested on a dataset of post-mortem iris images collected from 259 deceased subjects, the proposed method places among the three best iris matchers, demonstrating better results than the commercial (non-human-interpretable) VeriEye approach. We propose a unique post-mortem iris recognition method trained with human saliency to give fully-interpretable comparison outcomes for use in the context of forensic examination, achieving state-of-the-art recognition performance.

📄 PDF Abstract BibTeX arXiv:2208.03138

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingIris Recognition

Similar Papers 제목 키워드 기반

Person Re-identification by Saliency Learning

2014-12-05 · Rui Zhao, Wanli Ouyang, Xiaogang Wang

Human eyes can recognize person identities based on small salient regions, i.e. human saliency is distinctive and reliable in pedestrian matching across disjoint camera views. However, such valuable information is often …

Patch MatchingPerson Re-Identification

Evaluating Post-hoc Interpretability with Intrinsic Interpretability

2023-05-04 · José Pereira Amorim, Pedro Henriques Abreu, João Santos, Henning Müller

Despite Convolutional Neural Networks having reached human-level performance in some medical tasks, their clinical use has been hindered by their lack of interpretability. Two major interpretability strategies have been …

Saliency detection based on structural dissimilarity induced by image quality assessment model

2019-05-24 · Yang Li, Xuanqin Mou

The distinctiveness of image regions is widely used as the cue of saliency. Generally, the distinctiveness is computed according to the absolute difference of features. However, according to the image quality assessment …

Image Quality AssessmentSaliency Detection

Saliency Driven Image Manipulation

2016-12-07 · Roey Mechrez, Eli Shechtman, Lihi Zelnik-Manor

Have you ever taken a picture only to find out that an unimportant background object ended up being overly salient? Or one of those team sports photos where your favorite player blends with the rest? Wouldn't it be nice …

Image Manipulation

DeViT: Deformed Vision Transformers in Video Inpainting

2022-09-28 · Jiayin Cai, Changlin Li, Xin Tao, Chun Yuan 외

This paper proposes a novel video inpainting method. We make three main contributions: First, we extended previous Transformers with patch alignment by introducing Deformed Patch-based Homography (DePtH), which improves …

Video Inpainting