paper-with-me

Papers

Intensity-Spatial Dual Masked Autoencoder for Multi-Scale Feature Learning in Chest CT Segmentation

2024-11-20 · Yuexing Ding, Jun Wang, Hongbing Lyu

In the field of medical image segmentation, challenges such as indistinct lesion features, ambiguous boundaries,and multi-scale characteristics have long revailed. This paper proposes an improved method named Intensity-Spatial Dual Masked AutoEncoder (ISD-MAE). Based on the tissue-contrast semi-masked autoencoder, a Masked AutoEncoder (MAE) branch is introduced to perform intensity masking and spatial masking operations on chest CT images for multi-scale feature learning and segmentation tasks. The model utilizes a dual-branch structure and contrastive learning to enhance the ability to learn tissue features and boundary details. Experiments are conducted on multiple 2D and 3D datasets. The results show that ISD-MAE significantly outperforms other methods in 2D pneumonia and mediastinal tumor segmentation tasks. For example, the Dice score reaches 90.10% on the COVID19 LESION dataset, and the performance is relatively stable. However, there is still room for improvement on 3D datasets. In response to this, improvement directions are proposed, including optimizing the loss function, using enhanced 3D convolution blocks, and processing datasets from multiple perspectives.Our code is available at:https://github.com/prowontheus/ISD-MAE.

📄 PDF Abstract BibTeX arXiv:2411.13198

Code (1)

prowontheus/isd-mae 공식 구현 pytorch

Tasks

Contrastive LearningImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationTumor Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Contrastive Learning 설명 없음
3D Convolution A 3D Convolution is a type of convolution where the kernel slides in 3 dimensions as opposed to 2 dimensions with 2D…

Similar Papers 제목 키워드 기반

Revealing the Power of Masked Autoencoders in Traffic Forecasting

2023-09-26 · Jiarui Sun, Yujie Fan, Chin-Chia Michael Yeh, Wei zhang 외

Traffic forecasting, crucial for urban planning, requires accurate predictions of spatial-temporal traffic patterns across urban areas. Existing research mainly focuses on designing complex models that capture spatial-te…

DecoderMultivariate Time Series ForecastingTime SeriesTime Series Forecasting+1

Focus on Texture: Rethinking Pre-training in Masked Autoencoders for Medical Image Classification

2025-07-15 · Chetan Madan, Aarjav Satia, Soumen Basu, Pankaj Gupta 외 arxiv

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared erro…

Gallbladder Cancer DetectionMedical Image ClassificationUnsupervised Pre-trainingRepresentation Learning

Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder

2026-03-26 · Kewei Zhu, Yanze Xin, Jinwei Hu, Xiaoyuan Cheng 외 arxiv

Predicting high-dimensional dynamical systems with irregular time steps presents significant challenges for current data-driven algorithms. These irregularities arise from missing data, sparse observations, or adaptive c…

Computational Efficiency

Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images

2023-07-14 · Mariana-Iuliana Georgescu

Pathological anomalies exhibit diverse appearances in medical imaging, making it difficult to collect and annotate a representative amount of data required to train deep learning models in a supervised setting. Therefore…

Anomaly DetectionUnsupervised Anomaly Detection

Concatenated Masked Autoencoders as Spatial-Temporal Learner

2023-11-02 · Zhouqiang Jiang, Bowen Wang, Tong Xiang, Zhaofeng Niu 외

Learning representations from videos requires understanding continuous motion and visual correspondences between frames. In this paper, we introduce the Concatenated Masked Autoencoders (CatMAE) as a spatial-temporal lea…

Action RecognitionData AugmentationDecoderRepresentation Learning+2