paper-with-me

Papers

Representation Disentanglement for Multi-task Learning with application to Fetal Ultrasound

2019-08-21 · Qingjie Meng, Nick Pawlowski, Daniel Rueckert, Bernhard Kainz

One of the biggest challenges for deep learning algorithms in medical image analysis is the indiscriminate mixing of image properties, e.g. artifacts and anatomy. These entangled image properties lead to a semantically redundant feature encoding for the relevant task and thus lead to poor generalization of deep learning algorithms. In this paper we propose a novel representation disentanglement method to extract semantically meaningful and generalizable features for different tasks within a multi-task learning framework. Deep neural networks are utilized to ensure that the encoded features are maximally informative with respect to relevant tasks, while an adversarial regularization encourages these features to be disentangled and minimally informative about irrelevant tasks. We aim to use the disentangled representations to generalize the applicability of deep neural networks. We demonstrate the advantages of the proposed method on synthetic data as well as fetal ultrasound images. Our experiments illustrate that our method is capable of learning disentangled internal representations. It outperforms baseline methods in multiple tasks, especially on images with new properties, e.g. previously unseen artifacts in fetal ultrasound.

📄 PDF Abstract BibTeX arXiv:1908.07885

Code (1)

qmeng99/Multi-task-Representation-Disentanglement tf

Tasks

AnatomyDisentanglementMedical Image AnalysisMulti-Task Learning

Similar Papers 제목 키워드 기반

Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation

2025-10-14 · Xiao He, Huangxuan Zhao, Guojia Wan, Wei Zhou 외 arxiv

Recent medical vision-language models have shown promise on tasks such as VQA, report generation, and anomaly detection. However, most are adapted to structured adult imaging and underperform in fetal ultrasound, which p…

Reinforcement LearningAnomaly Detection

FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis

2025-02-20 · Fadillah Maani, Numan Saeed, Tausifa Saleem, Zaid Farooq 외

Foundation models are becoming increasingly effective in the medical domain, offering pre-trained models on large datasets that can be readily adapted for downstream tasks. Despite progress, fetal ultrasound images remai…

Age EstimationBenchmarking

Learning Cross-domain Generalizable Features by Representation Disentanglement

2020-02-29 · Qingjie Meng, Daniel Rueckert, Bernhard Kainz

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen c…

DiagnosticDisentanglementGeneral Classificationimage-classification+1

Revisiting Disentanglement in Downstream Tasks: A Study on Its Necessity for Abstract Visual Reasoning

2024-03-01 · Ruiqian Nai, Zixin Wen, Ji Li, Yuanzhi Li 외

In representation learning, a disentangled representation is highly desirable as it encodes generative factors of data in a separable and compact pattern. Researchers have advocated leveraging disentangled representation…

DisentanglementInformativenessRepresentation LearningVisual Reasoning

Celcomen: spatial causal disentanglement for single-cell and tissue perturbation modeling

2024-09-09 · Stathis Megas, Daniel G. Chen, Krzysztof Polanski, Moshe Eliasof 외

Celcomen leverages a mathematical causality framework to disentangle intra- and inter- cellular gene regulation programs in spatial transcriptomics and single-cell data through a generative graph neural network. It can l…

counterfactualDisentanglementGraph Neural Network