paper-with-me

Papers

Interpretable Structured Learning with Sparse Gated Sequence Encoder for Protein-Protein Interaction Prediction

2020-10-16 · Kishan Kc, Feng Cui, Anne Haake, Rui Li

Predicting protein-protein interactions (PPIs) by learning informative representations from amino acid sequences is a challenging yet important problem in biology. Although various deep learning models in Siamese architecture have been proposed to model PPIs from sequences, these methods are computationally expensive for a large number of PPIs due to the pairwise encoding process. Furthermore, these methods are difficult to interpret because of non-intuitive mappings from protein sequences to their sequence representation. To address these challenges, we present a novel deep framework to model and predict PPIs from sequence alone. Our model incorporates a bidirectional gated recurrent unit to learn sequence representations by leveraging contextualized and sequential information from sequences. We further employ a sparse regularization to model long-range dependencies between amino acids and to select important amino acids (protein motifs), thus enhancing interpretability. Besides, the novel design of the encoding process makes our model computationally efficient and scalable to an increasing number of interactions. Experimental results on up-to-date interaction datasets demonstrate that our model achieves superior performance compared to other state-of-the-art methods. Literature-based case studies illustrate the ability of our model to provide biological insights to interpret the predictions.

📄 PDF Abstract BibTeX arXiv:2010.08514

Code (1)

kckishan/InterpretablePIP 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Improving Dictionary Learning with Gated Sparse Autoencoders

2024-04-24 · Senthooran Rajamanoharan, Arthur Conmy, Lewis Smith, Tom Lieberum 외

Recent work has found that sparse autoencoders (SAEs) are an effective technique for unsupervised discovery of interpretable features in language models' (LMs) activations, by finding sparse, linear reconstructions of LM…

Dictionary Learning

Learning Retrieval Models with Sparse Autoencoders

2026-02-27 · Thibault Formal, Maxime Louis, Hervé Dejean, Stéphane Clinchant arxiv

Sparse autoencoders (SAEs) provide a powerful mechanism for decomposing the dense representations produced by Large Language Models (LLMs) into interpretable latent features. We posit that SAEs constitute a natural found…

Unpacking SDXL Turbo: Interpreting Text-to-Image Models with Sparse Autoencoders

2024-10-28 · Viacheslav Surkov, Chris Wendler, Mikhail Terekhov, Justin Deschenaux 외

Sparse autoencoders (SAEs) have become a core ingredient in the reverse engineering of large-language models (LLMs). For LLMs, they have been shown to decompose intermediate representations that often are not interpretab…

Denoising

Uncertainty Estimation in Autoregressive Structured Prediction

2020-02-18 · ICLR 2021 1 · Andrey Malinin, Mark Gales

Uncertainty estimation is important for ensuring safety and robustness of AI systems. While most research in the area has focused on un-structured prediction tasks, limited work has investigated general uncertainty estim…

Image ClassificationMachine TranslationPredictionspeech-recognition+3

Gated Attentive-Autoencoder for Content-Aware Recommendation

2018-12-07 · Chen Ma, Peng Kang, Bin Wu, Qinglong Wang 외

The rapid growth of Internet services and mobile devices provides an excellent opportunity to satisfy the strong demand for the personalized item or product recommendation. However, with the tremendous increase of users …

Product RecommendationRecommendation Systems