paper-with-me

홈 › Papers

iDNA-ABF: multi-scale deep biological language learning model for the interpretable prediction of DNA methylations

2022-10-17 · Genome Biology 2022 10 · Junru Jin, Yingying Yu, Ruheng Wang, Xin Zeng, Chao Pang, Yi Jiang, Zhongshen Li, Yutong Dai, Ran Su, Quan Zou, Kenta Nakai, Leyi Wei

In this study, we propose iDNA-ABF, a multi-scale deep biological language learning model that enables the interpretable prediction of DNA methylations based on genomic sequences only. Benchmarking comparisons show that our iDNA-ABF outperforms state-of-the-art methods for different methylation predictions. Importantly, we show the power of deep language learning in capturing both sequential and functional semantics information from background genomes. Moreover, by integrating the interpretable analysis mechanism, we well explain what the model learns, helping us build the mapping from the discovery of important sequential determinants to the in-depth analysis of their biological functions.

📄 PDF Abstract BibTeX

Code (2)

YUYING07/iDNA-ABF-automl 공식 구현 pytorch
FakeEnd/iDNA_ABF pytorch

Tasks

BenchmarkingText Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
AdamW AdamW is a stochastic optimization method that modifies the typical implementation of weight decay in Adam, by decoupling [weight…
Residual Connection 설명 없음
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model

2025-02-15 · Mingqian Ma, Guoqing Liu, Chuan Cao, Pan Deng 외

Advances in natural language processing and large language models have sparked growing interest in modeling DNA, often referred to as the "language of life". However, DNA modeling poses unique challenges. First, it requi…

Language ModelingLanguage ModellingState Space Models

Bride Kidnapping and Informal Governance Institutions

2024-02-05 · Zachary Porreca

Bride kidnapping is a form of forced marriage in which a woman is taken against her will and coerced into accepting marriage with her captor. Post-Soviet Kyrgyzstan has seen a large increase in the prominence of this pra…

Survey

Kidnapping Deep Learning-based Multirotors using Optimized Flying Adversarial Patches

2023-08-01 · Pia Hanfeld, Khaled Wahba, Marina M. -C. Höhne, Michael Bussmann 외

Autonomous flying robots, such as multirotors, often rely on deep learning models that make predictions based on a camera image, e.g. for pose estimation. These models can predict surprising results if applied to input i…

Deep LearningPose EstimationReal-World Adversarial AttackRobot Navigation

Lightweight Monocular Depth with a Novel Neural Architecture Search Method

2021-08-25 · Lam Huynh, Phong Nguyen, Jiri Matas, Esa Rahtu 외

This paper presents a novel neural architecture search method, called LiDNAS, for generating lightweight monocular depth estimation models. Unlike previous neural architecture search (NAS) approaches, where finding optim…

Depth EstimationDiversityMonocular Depth EstimationNeural Architecture Search

The Un-Kidnappable Robot: Acoustic Localization of Sneaking People

2023-10-05 · Mengyu Yang, Patrick Grady, Samarth Brahmbhatt, Arun Balajee Vasudevan 외

How easy is it to sneak up on a robot? We examine whether we can detect people using only the incidental sounds they produce as they move, even when they try to be quiet. We collect a robotic dataset of high-quality 4-ch…