An interpretable automated detection system for FISH-based HER2 oncogene amplification testing in histo-pathological routine images of breast and gastric cancer diagnostics
Histo-pathological diagnostics are an inherent part of the everyday work but are particularly laborious and associated with time-consuming manual analysis of image data. In order to cope with the increasing diagnostic case numbers due to the current growth and demographic change of the global population and the progress in personalized medicine, pathologists ask for assistance. Profiting from digital pathology and the use of artificial intelligence, individual solutions can be offered (e.g. detect labeled cancer tissue sections). The testing of the human epidermal growth factor receptor 2 (HER2) oncogene amplification status via fluorescence in situ hybridization (FISH) is recommended for breast and gastric cancer diagnostics and is regularly performed at clinics. Here, we develop an interpretable, deep learning (DL)-based pipeline which automates the evaluation of FISH images with respect to HER2 gene amplification testing. It mimics the pathological assessment and relies on the detection and localization of interphase nuclei based on instance segmentation networks. Furthermore, it localizes and classifies fluorescence signals within each nucleus with the help of image classification and object detection convolutional neural networks (CNNs). Finally, the pipeline classifies the whole image regarding its HER2 amplification status. The visualization of pixels on which the networks' decision occurs, complements an essential part to enable interpretability by pathologists.
Code (1)
Tasks
Diagnosticimage-classificationImage ClassificationInstance Segmentationobject-detectionObject DetectionSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Comparative study of the evolution of human cancer gene duplications across fish
Comparative studies of cancer-related genes allow us to gain novel information about the evolution and function of these genes, but also to understand cancer as a driving force in biological systems and species life hist…
FisheyeMultiNet: Real-time Multi-task Learning Architecture for Surround-view Automated Parking System
Automated Parking is a low speed manoeuvring scenario which is quite unstructured and complex, requiring full 360{\deg} near-field sensing around the vehicle. In this paper, we discuss the design and implementation of an…
Deep LearningMulti-Task Learningobject-detectionObject Detection+2Further Thoughts on Abnormal Chromatin Configuration and Oncogenesis
More than 30 years ago, we published a paper entitled as abnormal chromatin configuration and oncogenesis, which proposed the first hypothesis that links oncogenesis to abnormal three-dimensional (3D) genome structure. R…
FisheyeSuperPoint: Keypoint Detection and Description Network for Fisheye Images
Keypoint detection and description is a commonly used building block in computer vision systems particularly for robotics and autonomous driving. However, the majority of techniques to date have focused on standard camer…
Autonomous DrivingHomography EstimationKeypoint DetectionFisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving
Object detection is a mature problem in autonomous driving with pedestrian detection being one of the first deployed algorithms. It has been comprehensively studied in the literature. However, object detection is relativ…
ARCAutonomous DrivingInstance SegmentationObject+4