paper-with-me

홈 › Papers

Siamese Content-based Search Engine for a More Transparent Skin and Breast Cancer Diagnosis through Histological Imaging

2024-01-16 · Zahra Tabatabaei, Adrián Colomer, Javier Oliver Moll, Valery Naranjo

Computer Aid Diagnosis (CAD) has developed digital pathology with Deep Learning (DL)-based tools to assist pathologists in decision-making. Content-Based Histopathological Image Retrieval (CBHIR) is a novel tool to seek highly correlated patches in terms of similarity in histopathological features. In this work, we proposed two CBHIR approaches on breast (Breast-twins) and skin cancer (Skin-twins) data sets for robust and accurate patch-level retrieval, integrating a custom-built Siamese network as a feature extractor. The proposed Siamese network is able to generalize for unseen images by focusing on the similar histopathological features of the input pairs. The proposed CBHIR approaches are evaluated on the Breast (public) and Skin (private) data sets with top K accuracy. Finding the optimum amount of K is challenging, but also, as much as K increases, the dissimilarity between the query and the returned images increases which might mislead the pathologists. To the best of the author's belief, this paper is tackling this issue for the first time on histopathological images by evaluating the top first retrieved images. The Breast-twins model achieves 70% of the F1score at the top first, which exceeds the other state-of-the-art methods at a higher amount of K such as 5 and 400. Skin-twins overpasses the recently proposed Convolutional Auto Encoder (CAE) by 67%, increasing the precision. Besides, the Skin-twins model tackles the challenges of Spitzoid Tumors of Uncertain Malignant Potential (STUMP) to assist pathologists with retrieving top K images and their corresponding labels. So, this approach can offer a more explainable CAD tool to pathologists in terms of transparency, trustworthiness, or reliability among other characteristics.

📄 PDF Abstract BibTeX arXiv:2401.08272

Code (0)

등록된 구현이 없습니다.

Tasks

Image RetrievalRetrieval

Methods 이 논문이 사용한 방법론

Siamese Network 설명 없음

Similar Papers 제목 키워드 기반

Multi-label Sound Event Retrieval Using a Deep Learning-based Siamese Structure with a Pairwise Presence Matrix

2020-02-20 · Jianyu Fan, Eric Nichols, Daniel Tompkins, Ana Elisa Mendez Mendez 외

Realistic recordings of soundscapes often have multiple sound events co-occurring, such as car horns, engine and human voices. Sound event retrieval is a type of content-based search aiming at finding audio samples, simi…

Retrieval

Siamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Dataset

2021-12-03 · Matěj Kocián, Jakub Náplava, Daniel Štancl, Vladimír Kadlec

Web search engines focus on serving highly relevant results within hundreds of milliseconds. Pre-trained language transformer models such as BERT are therefore hard to use in this scenario due to their high computational…

Document RankingLanguage ModelingSmall Language Model

Content-Based Landmark Retrieval Combining Global and Local Features using Siamese Neural Networks

2022-08-03 · Tianyi Hu, Monika Kwiatkowski, Simon Matern, Olaf Hellwich

In this work, we present a method for landmark retrieval that utilizes global and local features. A Siamese network is used for global feature extraction and metric learning, which gives an initial ranking of the landmar…

Metric LearningRe-RankingRetrievalTransfer Learning

SiENet: Siamese Expansion Network for Image Extrapolation

2020-07-08 · Xiaofeng Zhang, Feng Chen, Cailing Wang, Songsong Wu 외

Different from image inpainting, image outpainting has relative less context in the image center to capture and more content at the image border to predict. Therefore, classical encoder-decoder pipeline of existing metho…

DecoderImage InpaintingImage Outpainting

UniMark: Artificial Intelligence Generated Content Identification Toolkit

2025-12-13 · Meilin Li, Ji He, Yi Yu, Jia Xu 외 arxiv

The rapid proliferation of Artificial Intelligence Generated Content has precipitated a crisis of trust and urgent regulatory demands. However, existing identification tools suffer from fragmentation and a lack of suppor…