ACE: Anatomically Consistent Embeddings in Composition and Decomposition
Medical images acquired from standardized protocols show consistent macroscopic or microscopic anatomical structures, and these structures consist of composable/decomposable organs and tissues, but existing self-supervised learning (SSL) methods do not appreciate such composable/decomposable structure attributes inherent to medical images. To overcome this limitation, this paper introduces a novel SSL approach called ACE to learn anatomically consistent embedding via composition and decomposition with two key branches: (1) global consistency, capturing discriminative macro-structures via extracting global features; (2) local consistency, learning fine-grained anatomical details from composable/decomposable patch features via corresponding matrix matching. Experimental results across 6 datasets 2 backbones, evaluated in few-shot learning, fine-tuning, and property analysis, show ACE's superior robustness, transferability, and clinical potential. The innovations of our ACE lie in grid-wise image cropping, leveraging the intrinsic properties of compositionality and decompositionality of medical images, bridging the semantic gap from high-level pathologies to low-level tissue anomalies, and providing a new SSL method for medical imaging.
Code (1)
Tasks
Few-Shot LearningImage CroppingSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Encoding CT Anatomy Knowledge for Unpaired Chest X-ray Image Decomposition
Although chest X-ray (CXR) offers a 2D projection with overlapped anatomies, it is widely used for clinical diagnosis. There is clinical evidence supporting that decomposing an X-ray image into different components (e.g.…
AnatomyDiagnosticDisentanglementGenerative Adversarial NetworkOblivious subspace embeddings for compressed Tucker decompositions
Emphasis in the tensor literature on random embeddings (tools for low-distortion dimension reduction) for the canonical polyadic (CP) tensor decomposition has left analogous results for the more expressive Tucker decompo…
Dimensionality ReductionTensor DecompositionUnderstanding Composition of Word Embeddings via Tensor Decomposition
Word embedding is a powerful tool in natural language processing. In this paper we consider the problem of word embedding composition \--- given vector representations of two words, compute a vector for the entire phrase…
Tensor DecompositionWord EmbeddingsVMDNet: Temporal Leakage-Free Variational Mode Decomposition for Electricity Demand Forecasting
Accurate electricity demand forecasting is challenging due to the strong multi-periodicity of real-world demand series, which makes effective modeling of recurrent temporal patterns crucial. Decomposition techniques make…
A Biophysical-Model-Informed Source Separation Framework For EMG Decomposition
Recent advances in neural interfacing have enabled significant improvements in human-computer interaction, rehabilitation, and neuromuscular diagnostics. Motor unit (MU) decomposition from surface electromyography (sEMG)…