paper-with-me

홈 › Papers

ScRAE: Deterministic Regularized Autoencoders with Flexible Priors for Clustering Single-cell Gene Expression Data

2021-07-16 · Arnab Kumar Mondal, Himanshu Asnani, Parag Singla, Prathosh AP

Clustering single-cell RNA sequence (scRNA-seq) data poses statistical and computational challenges due to their high-dimensionality and data-sparsity, also known as `dropout' events. Recently, Regularized Auto-Encoder (RAE) based deep neural network models have achieved remarkable success in learning robust low-dimensional representations. The basic idea in RAEs is to learn a non-linear mapping from the high-dimensional data space to a low-dimensional latent space and vice-versa, simultaneously imposing a distributional prior on the latent space, which brings in a regularization effect. This paper argues that RAEs suffer from the infamous problem of bias-variance trade-off in their naive formulation. While a simple AE without a latent regularization results in data over-fitting, a very strong prior leads to under-representation and thus bad clustering. To address the above issues, we propose a modified RAE framework (called the scRAE) for effective clustering of the single-cell RNA sequencing data. scRAE consists of deterministic AE with a flexibly learnable prior generator network, which is jointly trained with the AE. This facilitates scRAE to trade-off better between the bias and variance in the latent space. We demonstrate the efficacy of the proposed method through extensive experimentation on several real-world single-cell Gene expression datasets.

📄 PDF Abstract BibTeX arXiv:2107.07709

Code (1)

arnabkmondal/scRAE 공식 구현 tf

Tasks

Clustering

Methods 이 논문이 사용한 방법론

RAE This method introduces several regularization schemes that can be applied to an Autoencoder. To make the model generative *ex-post* density estimation is proposed and consists in…
AE An autoencoder is a type of artificial neural network used to learn efficient data codings in an unsupervised manner. The aim of an autoencoder is to learn a representation…

Similar Papers 제목 키워드 기반

Deterministic Decoding for Discrete Data in Variational Autoencoders

2020-03-04 · Daniil Polykovskiy, Dmitry Vetrov

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder…

Decoder

Adversarially Regularized Autoencoders

2017-06-13 · Jake Zhao, Yoon Kim, Kelly Zhang, Alexander M. Rush 외

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to d…

Representation LearningStyle Transfer

From Variational to Deterministic Autoencoders

2019-03-29 · ICLR 2020 1 · Partha Ghosh, Mehdi S. M. Sajjadi, Antonio Vergari, Michael Black 외

Variational Autoencoders (VAEs) provide a theoretically-backed and popular framework for deep generative models. However, learning a VAE from data poses still unanswered theoretical questions and considerable practical c…

DecoderDensity Estimation

Shape your Space: A Gaussian Mixture Regularization Approach to Deterministic Autoencoders

2021-12-01 · NeurIPS 2021 12 · Amrutha Saseendran, Kathrin Skubch, Stefan Falkner, Margret Keuper

Variational Autoencoders (VAEs) are powerful probabilistic models to learn representations of complex data distributions. One important limitation of VAEs is the strong prior assumption that latent representations learne…

Density Estimation

Non-linear, Sparse Dimensionality Reduction via Path Lasso Penalized Autoencoders

2021-02-22 · Oskar Allerbo, Rebecka Jörnsten

High-dimensional data sets are often analyzed and explored via the construction of a latent low-dimensional space which enables convenient visualization and efficient predictive modeling or clustering. For complex data s…

ClusteringDimensionality Reduction