paper-with-me

홈 › Papers

MRNet: Multifaceted Resilient Networks for Medical Image-to-Image Translation

2024-12-04 · Hyojeong Lee, Youngwan Jo, Inpyo Hong, Sanghyun Park

We propose a Multifaceted Resilient Network(MRNet), a novel architecture developed for medical image-to-image translation that outperforms state-of-the-art methods in MRI-to-CT and MRI-to-MRI conversion. MRNet leverages the Segment Anything Model (SAM) to exploit frequency-based features to build a powerful method for advanced medical image transformation. The architecture extracts comprehensive multiscale features from diverse datasets using a powerful SAM image encoder and performs resolution-aware feature fusion that consistently integrates U-Net encoder outputs with SAM-derived features. This fusion optimizes the traditional U-Net skip connection while leveraging transformer-based contextual analysis. The translation is complemented by an innovative dual-mask configuration incorporating dynamic attention patterns and a specialized loss function designed to address regional mapping mismatches, preserving both the gross anatomy and tissue details. Extensive validation studies have shown that MRNet outperforms state-of-the-art architectures, particularly in maintaining anatomical fidelity and minimizing translation artifacts.

📄 PDF Abstract BibTeX arXiv:2412.03039

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyImage-to-Image TranslationTranslation

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
SAM 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Learning Calibrated Medical Image Segmentation via Multi-Rater Agreement Modeling

2021-06-19 · CVPR 2021 1 · Wei Ji, Shuang Yu, Junde Wu, Kai Ma 외

In medical image analysis, it is typical to collect multiple annotations, each from a different clinical expert or rater, in the expectation that possible diagnostic errors could be mitigated. Meanwhile, from the com…

DiagnosticImage SegmentationMedical Image AnalysisMedical Image Segmentation+2

CMRNet: Camera to LiDAR-Map Registration

2019-06-24 · Daniele Cattaneo, Matteo Vaghi, Augusto Luis Ballardini, Simone Fontana 외

In this paper we present CMRNet, a realtime approach based on a Convolutional Neural Network to localize an RGB image of a scene in a map built from LiDAR data. Our network is not trained in the working area, i.e. CMRNet…

Camera Localization

QMRNet: Quality Metric Regression for EO Image Quality Assessment and Super-Resolution

2022-10-12 · David Berga, Pau Gallés, Katalin Takáts, Eva Mohedano 외

Latest advances in Super-Resolution (SR) have been tested with general purpose images such as faces, landscapes and objects, mainly unused for the task of super-resolving Earth Observation (EO) images. In this research p…

Earth ObservationImage CompressionImage Quality AssessmentNo-Reference Image Quality Assessment+2

Manifold Regularized Deep Neural Networks using Adversarial Examples

2015-11-19 · Taehoon Lee, Minsuk Choi, Sungroh Yoon

Learning meaningful representations using deep neural networks involves designing efficient training schemes and well-structured networks. Currently, the method of stochastic gradient descent that has a momentum with dro…

General Classification

Expandable, Compressible, Mineable: Open-World Thermal Image Restoration

2026-05-16 · Pu Li, Huafeng Li, Yafei Zhang, Wen Wang 외 arxiv

In open-world settings, thermal infrared (TIR) image degradations continuously emerge and evolve, while most existing all-in-one restoration methods are built on a closed-set assumption and struggle to continually adapt …

Continual LearningImage Restoration