View it like a radiologist: Shifted windows for deep learning augmentation of CT images
Deep learning has the potential to revolutionize medical practice by automating and performing important tasks like detecting and delineating the size and locations of cancers in medical images. However, most deep learning models rely on augmentation techniques that treat medical images as natural images. For contrast-enhanced Computed Tomography (CT) images in particular, the signals producing the voxel intensities have physical meaning, which is lost during preprocessing and augmentation when treating such images as natural images. To address this, we propose a novel preprocessing and intensity augmentation scheme inspired by how radiologists leverage multiple viewing windows when evaluating CT images. Our proposed method, window shifting, randomly places the viewing windows around the region of interest during training. This approach improves liver lesion segmentation performance and robustness on images with poorly timed contrast agent. Our method outperforms classical intensity augmentations as well as the intensity augmentation pipeline of the popular nn-UNet on multiple datasets.
Code (1)
Tasks
Computed Tomography (CT)Lesion SegmentationSimilar Papers 제목 키워드 기반
R3D-SWIN:Use Shifted Window Attention for Single-View 3D Reconstruction
Recently, vision transformers have performed well in various computer vision tasks, including voxel 3D reconstruction. However, the windows of the vision transformer are not multi-scale, and there is no connection betwee…
3D ReconstructionSingle-View 3D ReconstructionLearning Better Contrastive View from Radiologist's Gaze
Recent self-supervised contrastive learning methods greatly benefit from the Siamese structure that aims to minimizing distances between positive pairs. These methods usually apply random data augmentation to input image…
Contrastive LearningData AugmentationMSW-Transformer: Multi-Scale Shifted Windows Transformer Networks for 12-Lead ECG Classification
Automatic classification of electrocardiogram (ECG) signals plays a crucial role in the early prevention and diagnosis of cardiovascular diseases. While ECG signals can be used for the diagnosis of various diseases, thei…
ClassificationDiagnosticECG ClassificationRhythmAgileIR: Memory-Efficient Group Shifted Windows Attention for Agile Image Restoration
Image Transformers show a magnificent success in Image Restoration tasks. Nevertheless, most of transformer-based models are strictly bounded by exorbitant memory occupancy. Our goal is to reduce the memory consumption o…
Image RestorationQuantizationReflection Removal Using Ghosting Cues
Photographs taken through glass windows often contain both the desired scene and undesired reflections. Separating the reflection and transmission layers is an important but ill-posed problem that has both aesthetic and …
Reflection Removal