paper-with-me

홈 › Papers

Joint multi-task learning improves weakly-supervised biomarker prediction in computational pathology

2024-03-06 · Omar S. M. El Nahhas, Georg Wölflein, Marta Ligero, Tim Lenz, Marko van Treeck, Firas Khader, Daniel Truhn, Jakob Nikolas Kather

Deep Learning (DL) can predict biomarkers directly from digitized cancer histology in a weakly-supervised setting. Recently, the prediction of continuous biomarkers through regression-based DL has seen an increasing interest. Nonetheless, clinical decision making often requires a categorical outcome. Consequently, we developed a weakly-supervised joint multi-task Transformer architecture which has been trained and evaluated on four public patient cohorts for the prediction of two key predictive biomarkers, microsatellite instability (MSI) and homologous recombination deficiency (HRD), trained with auxiliary regression tasks related to the tumor microenvironment. Moreover, we perform a comprehensive benchmark of 16 approaches of task balancing for weakly-supervised joint multi-task learning in computational pathology. Using our novel approach, we improve over the state-of-the-art area under the receiver operating characteristic by +7.7% and +4.1%, as well as yielding better clustering of latent embeddings by +8% and +5% for the prediction of MSI and HRD in external cohorts, respectively.

📄 PDF Abstract BibTeX arXiv:2403.03891

Code (1)

avic3nna/joint-mtl-cpath 공식 구현 pytorch

Tasks

Decision MakingMulti-Task LearningPredictionregression

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Cross-task weakly supervised learning from instructional videos

2019-03-19 · CVPR 2019 6 · Dimitri Zhukov, Jean-Baptiste Alayrac, Ramazan Gokberk Cinbis, David Fouhey 외

In this paper we investigate learning visual models for the steps of ordinary tasks using weak supervision via instructional narrations and an ordered list of steps instead of strong supervision via temporal annotations.…

Weakly-supervised Learning

Pairwise Similarity Knowledge Transfer for Weakly Supervised Object Localization

2020-03-18 · ECCV 2020 8 · Amir Rahimi, Amirreza Shaban, Thalaiyasingam Ajanthan, Richard Hartley 외

Weakly Supervised Object Localization (WSOL) methods only require image level labels as opposed to expensive bounding box annotations required by fully supervised algorithms. We study the problem of learning localization…

Object LocalizationTransfer LearningWeakly-Supervised Object Localization

DeepHandMesh: A Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modeling

2020-08-19 · ECCV 2020 8 · Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee

Human hands play a central role in interacting with other people and objects. For realistic replication of such hand motions, high-fidelity hand meshes have to be reconstructed. In this study, we firstly propose DeepHand…

Decoder

Weakly Supervised Multi-Object Tracking and Segmentation

2021-01-03 · Idoia Ruiz, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder 외

We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. …

Instance SegmentationMulti-Object TrackingMulti-Object Tracking and SegmentationMulti-Task Learning+6

Learning more expressive joint distributions in multimodal variational methods

2020-09-08 · Sasho Nedelkoski, Mihail Bogojeski, Odej Kao

Data often are formed of multiple modalities, which jointly describe the observed phenomena. Modeling the joint distribution of multimodal data requires larger expressive power to capture high-level concepts and provide …

ColorizationVariational InferenceWeakly-supervised Learning