paper-with-me

홈 › Papers

DeepGene Transformer: Transformer for the gene expression-based classification of cancer subtypes

2021-08-26 · Anwar Khan, Boreom Lee

Cancer and its subtypes constitute approximately 30% of all causes of death globally and display a wide range of heterogeneity in terms of clinical and molecular responses to therapy. Molecular subtyping has enabled the use of precision medicine to overcome these challenges and provide significant biological insights to predict prognosis and improve clinical decision-making. Over the past decade, conventional machine learning (ML) and deep learning (DL) algorithms have been widely espoused for the classification of cancer subtypes from gene expression datasets. However, these methods are potentially biased toward the identification of cancer biomarkers. Hence, an end-to-end deep learning approach, DeepGene Transformer, is proposed which addresses the complexity of high-dimensional gene expression with a multi-head self-attention module by identifying relevant biomarkers across multiple cancer subtypes without requiring feature selection as a pre-requisite for the current classification algorithms. Comparative analysis reveals that the proposed DeepGene Transformer outperformed the commonly used traditional and state-of-the-art classification algorithms and can be considered an efficient approach for classifying cancer and its subtypes, indicating that any improvement in deep learning models in computational biologists can be reflected well in this domain as well.

📄 PDF Abstract BibTeX arXiv:2108.11833

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDecision MakingDeep Learningfeature selectionPrognosis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

DeepGeneMD: A Joint Deep Learning Model for Extracting Gene Mutation-Disease Knowledge from PubMed Literature

2019-11-01 · WS 2019 11 · Feifan Liu, Xiaoyu Zheng, Bo wang, Catarina Kiefe

Understanding the pathogenesis of genetic diseases through different gene activities and their relations to relevant diseases is important for new drug discovery and drug repositioning. In this paper, we present a joint …

Drug DiscoveryMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+3

BERT got a Date: Introducing Transformers to Temporal Tagging

2021-09-30 · Satya Almasian, Dennis Aumiller, Michael Gertz

Temporal expressions in text play a significant role in language understanding and correctly identifying them is fundamental to various retrieval and natural language processing systems. Previous works have slowly shifte…

ClassificationDecoderLanguage ModelingLanguage Modelling+4

Boosting Transformers for Job Expression Extraction and Classification in a Low-Resource Setting

2021-09-17 · Lukas Lange, Heike Adel, Jannik Strötgen

In this paper, we explore possible improvements of transformer models in a low-resource setting. In particular, we present our approaches to tackle the first two of three subtasks of the MEDDOPROF competition, i.e., the …

Transfer LearningXLM-R

BERT got a Date: Introducing Transformers to Temporal Tagging

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Temporal expressions in text play a significant role in language understanding, and correctly identifying them is fundamental to various retrieval and natural language processing systems. Previous works have slowly shift…

ClassificationDecoderLanguage ModelingLanguage Modelling+4

Cross-Task Multi-Branch Vision Transformer for Facial Expression and Mask Wearing Classification

2024-04-22 · Armando Zhu, Keqin Li, Tong Wu, Peng Zhao 외

With wearing masks becoming a new cultural norm, facial expression recognition (FER) while taking masks into account has become a significant challenge. In this paper, we propose a unified multi-branch vision transformer…

Facial Expression RecognitionFacial Expression Recognition (FER)