paper-with-me

홈 › Papers

Self-GenomeNet: Self-supervised Learning with Reverse-Complement Context Prediction for Nucleotide-level Genomics Data

2021-09-29 · Hüseyin Anil Gündüz, Martin Binder, Xiao-Yin To, René Mreches, Philipp C. Münch, Alice C McHardy, Bernd Bischl, Mina Rezaei

We introduce Self-GenomeNet, a novel contrastive self-supervised learning method for nucleotide-level genomic data, which substantially improves the quality of the learned representations and performance compared to the current state-of-the-art deep learning frameworks. To the best of our knowledge, Self-GenomeNet is the first self-supervised framework that learns a representation of nucleotide-level genome data, using domain-specific characteristics. Our proposed method learns and parametrizes the latent space by leveraging the reverse-complement of genomic sequences. During the training procedure, we force our framework to capture semantic representations with a novel context network on top of intermediate features extracted by an encoder network. The network is trained with an unsupervised contrastive loss. Extensive experiments show that our method with self-supervised and semi-supervised settings is able to considerably outperform previous deep learning methods on different datasets and a public bioinformatics benchmark. Moreover, the learned representations generalize well when transferred to new datasets and tasks. The source code of the method and all the experiments are available at supplementary.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

Self-supervised Learning to Bring Dual Reversed Rolling Shutter Images Alive

2023-05-31 · ICCV 2023 1 · Wei Shang, Dongwei Ren, Chaoyu Feng, Xiaotao Wang 외

Modern consumer cameras usually employ the rolling shutter (RS) mechanism, where images are captured by scanning scenes row-by-row, yielding RS distortions for dynamic scenes. To correct RS distortions, existing methods …

Self-Supervised Learning

SelfDRSC++: Self-Supervised Learning for Dual Reversed Rolling Shutter Correction

2024-08-21 · Wei Shang, Dongwei Ren, Wanying Zhang, Qilong Wang 외

Modern consumer cameras commonly employ the rolling shutter (RS) imaging mechanism, via which images are captured by scanning scenes row-by-row, resulting in RS distortion for dynamic scenes. To correct RS distortion, ex…

distortion correctionRolling Shutter CorrectionSelf-Supervised LearningVideo Frame Interpolation

A Simple Self-Supervised ECG Representation Learning Method via Manipulated Temporal-Spatial Reverse Detection

2022-02-25 · Wenrui Zhang, Shijia Geng, Shenda Hong

Learning representations from electrocardiogram (ECG) signals can serve as a fundamental step for different machine learning-based ECG tasks. In order to extract general ECG representations that can be adapted to various…

Representation LearningSelf-Supervised Learning

Time-Reversal Provides Unsupervised Feedback to LLMs

2024-12-03 · Yerram Varun, Rahul Madhavan, Sravanti Addepalli, Arun Suggala 외

Large Language Models (LLMs) are typically trained to predict in the forward direction of time. However, recent works have shown that prompting these models to look back and critique their own generations can produce use…

Passage RetrievalRe-Ranking

Double Reverse Regularization Network Based on Self-Knowledge Distillation for SAR Object Classification

2023-11-26 · Bo Xu, Hao Zheng, Zhigang Hu, Liu Yang 외

In current synthetic aperture radar (SAR) object classification, one of the major challenges is the severe overfitting issue due to the limited dataset (few-shot) and noisy data. Considering the advantages of knowledge d…

Knowledge DistillationSelf-Knowledge Distillation