PocketNet: A Smaller Neural Network for Medical Image Analysis
Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by throttling the growth of the number of channels in convolutional neural networks. We demonstrate that, for a range of segmentation and classification tasks, PocketNet architectures produce results comparable to that of conventional neural networks while reducing the number of parameters by multiple orders of magnitude, using up to 90% less GPU memory, and speeding up training times by up to 40%, thereby allowing such models to be trained and deployed in resource-constrained settings.
Code (2)
Tasks
Deep LearningGPUMedical Image AnalysisMedical Image SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Two Stage Segmentation of Cervical Tumors using PocketNet
Cervical cancer remains the fourth most common malignancy amongst women worldwide.1 Concurrent chemoradiotherapy (CRT) serves as the mainstay definitive treatment regimen for locally advanced cervical cancers and include…
AnatomyComputed Tomography (CT)Organ SegmentationSegmentation+1PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation
Deep neural networks have rapidly become the mainstream method for face recognition (FR). However, this limits the deployment of such models that contain an extremely large number of parameters to embedded and low-end de…
Face RecognitionKnowledge DistillationLightweight Face RecognitionNeural Architecture SearchGlobally-Aware Multiple Instance Classifier for Breast Cancer Screening
Deep learning models designed for visual classification tasks on natural images have become prevalent in medical image analysis. However, medical images differ from typical natural images in many ways, such as significan…
General ClassificationMedical Image AnalysisSSEGEP: Small SEGment Emphasized Performance evaluation metric for medical image segmentation
Automatic image segmentation is a critical component of medical image analysis, and hence quantifying segmentation performance is crucial. Challenges in medical image segmentation are mainly due to spatial variations of …
Image SegmentationMedical Image AnalysisMedical Image SegmentationSegmentation+1Masked Image Modeling Advances 3D Medical Image Analysis
Recently, masked image modeling (MIM) has gained considerable attention due to its capacity to learn from vast amounts of unlabeled data and has been demonstrated to be effective on a wide variety of vision tasks involvi…
Contrastive LearningDecoderImage SegmentationMedical Image Analysis+3