Self-omics: A Self-supervised Learning Framework for Multi-omics Cancer Data

2022-10-03 · Sayed Hashim, Karthik Nandakumar, Mohammad Yaqub

We have gained access to vast amounts of multi-omics data thanks to Next Generation Sequencing. However, it is challenging to analyse this data due to its high dimensionality and much of it not being annotated. Lack of annotated data is a significant problem in machine learning, and Self-Supervised Learning (SSL) methods are typically used to deal with limited labelled data. However, there is a lack of studies that use SSL methods to exploit inter-omics relationships on unlabelled multi-omics data. In this work, we develop a novel and efficient pre-training paradigm that consists of various SSL components, including but not limited to contrastive alignment, data recovery from corrupted samples, and using one type of omics data to recover other omic types. Our pre-training paradigm improves performance on downstream tasks with limited labelled data. We show that our approach outperforms the state-of-the-art method in cancer type classification on the TCGA pan-cancer dataset in semi-supervised setting. Moreover, we show that the encoders that are pre-trained using our approach can be used as powerful feature extractors even without fine-tuning. Our ablation study shows that the method is not overly dependent on any pretext task component. The network architectures in our approach are designed to handle missing omic types and multiple datasets for pre-training and downstream training. Our pre-training paradigm can be extended to perform zero-shot classification of rare cancers.

📄 PDF Abstract BibTeX arXiv:2210.00825

Code (1)

hashimsayed0/self-omics 공식 구현 pytorch

Tasks

Cancer type classificationSelf-Supervised Learningzero-shot-classificationZero-Shot Learning

Self-supervised learning of multi-omics embeddings in the low-label, high-data regime

2023-11-16 · Christian John Hurry, Emma Slade

Contrastive, self-supervised learning (SSL) is used to train a model that predicts cancer type from miRNA, mRNA or RPPA expression data. This model, a pretrained FT-Transformer, is shown to outperform XGBoost and CatBoos…

Self-Supervised Learning

Imbalance-Aware Self-Supervised Learning for 3D Radiomic Representations

2021-03-06 · Hongwei Li, Fei-Fei Xue, Krishna Chaitanya, Shengda Luo 외

Radiomic representations can quantify properties of regions of interest in medical image data. Classically, they account for pre-defined statistics of shape, texture, and other low-level image features. Alternatively, de…

Brain Tumor Classification Representation Learning Self-Supervised Learning

VIME: Extending the Success of Self- and Semi-supervised Learning to Tabular Domain

2020-12-01 · NeurIPS 2020 12 · Jinsung Yoon, Yao Zhang, James Jordon, Mihaela van der Schaar

Self- and semi-supervised learning frameworks have made significant progress in training machine learning models with limited labeled data in image and language domains. These methods heavily rely on the unique structure…

Data Augmentation Imputation Self-Supervised Learning

MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models

2026-03-09 · Minsoo Lee, Jonghyun Kim, Juseung Yun, Sunwoo Yu 외 arxiv

Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spat…

Self-GenomeNet: Self-supervised Learning with Reverse-Complement Context Prediction for Nucleotide-level Genomics Data

2021-09-29 · Hüseyin Anil Gündüz, Martin Binder, Xiao-Yin To, René Mreches 외

We introduce Self-GenomeNet, a novel contrastive self-supervised learning method for nucleotide-level genomic data, which substantially improves the quality of the learned representations and performance compared to the …