HookNet: multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide images
We propose HookNet, a semantic segmentation model for histopathology whole-slide images, which combines context and details via multiple branches of encoder-decoder convolutional neural networks. Concentricpatches at multiple resolutions with different fields of view are used to feed different branches of HookNet, and intermediate representations are combined via a hooking mechanism. We describe a framework to design and train HookNet for achieving high-resolution semantic segmentation and introduce constraints to guarantee pixel-wise alignment in feature maps during hooking. We show the advantages of using HookNet in two histopathology image segmentation tasks where tissue type prediction accuracy strongly depends on contextual information, namely (1) multi-class tissue segmentation in breast cancer and, (2) segmentation of tertiary lymphoid structures and germinal centers in lung cancer. Weshow the superiority of HookNet when compared with single-resolution U-Net models working at different resolutions as well as with a recently published multi-resolution model for histopathology image segmentation
Code (1)
Tasks
DecoderImage SegmentationSegmentationSemantic SegmentationType predictionwhole slide imagesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AMD-HookNet for Glacier Front Segmentation
Knowledge on changes in glacier calving front positions is important for assessing the status of glaciers. Remote sensing imagery provides the ideal database for monitoring calving front positions, however, it is not fea…
Calving Front Delineation In Synthetic Aperture Radar ImageryCalving Front Delineation In Synthetic Aperture Radar Imagery With Fixed Training AmountSegmentationAMD-HookNet++: Evolution of AMD-HookNet with Hybrid CNN-Transformer Feature Enhancement for Glacier Calving Front Segmentation
The dynamics of glaciers and ice shelf fronts significantly impact the mass balance of ice sheets and coastal sea levels. To effectively monitor glacier conditions, it is crucial to consistently estimate positional shift…
Metric LearningImproved distinct bone segmentation in upper-body CT through multi-resolution networks
Purpose: Automated distinct bone segmentation from CT scans is widely used in planning and navigation workflows. U-Net variants are known to provide excellent results in supervised semantic segmentation. However, in dist…
3D ArchitectureSegmentationSemantic SegmentationRiFCN: Recurrent Network in Fully Convolutional Network for Semantic Segmentation of High Resolution Remote Sensing Images
Semantic segmentation in high resolution remote sensing images is a fundamental and challenging task. Convolutional neural networks (CNNs), such as fully convolutional network (FCN) and SegNet, have shown outstanding per…
SegmentationSemantic SegmentationLabel Refinement Network for Coarse-to-Fine Semantic Segmentation
We consider the problem of semantic image segmentation using deep convolutional neural networks. We propose a novel network architecture called the label refinement network that predicts segmentation labels in a coarse-t…
Image SegmentationSegmentationSemantic Segmentation