paper-with-me

홈 › Papers

Protein Folding with Neural Ordinary Differential Equations

2025-10-17 · Arielle Sanford, Shuo Sun, Christian B. Mendl arxiv

Recent advances in protein structure prediction, such as AlphaFold, have demonstrated the power of deep neural architectures like the Evoformer for capturing complex spatial and evolutionary constraints on protein conformation. However, the depth of the Evoformer, comprising 48 stacked blocks, introduces high computational costs and rigid layerwise discretization. Inspired by Neural Ordinary Differential Equations (Neural ODEs), we propose a continuous-depth formulation of the Evoformer, replacing its 48 discrete blocks with a Neural ODE parameterization that preserves its core attention-based operations. This continuous-time Evoformer achieves constant memory cost (in depth) via the adjoint method, while allowing a principled trade-off between runtime and accuracy through adaptive ODE solvers. Benchmarking on protein structure prediction tasks, we find that the Neural ODE-based Evoformer produces structurally plausible predictions and reliably captures certain secondary structure elements, such as alpha-helices, though it does not fully replicate the accuracy of the original architecture. However, our model achieves this performance using dramatically fewer resources, just 17.5 hours of training on a single GPU, highlighting the promise of continuous-depth models as a lightweight and interpretable alternative for biomolecular modeling. This work opens new directions for efficient and adaptive protein structure prediction frameworks.

📄 PDF Abstract BibTeX arXiv:2510.16253

Code (0)

등록된 구현이 없습니다.

Tasks

Protein Structure Prediction

Similar Papers 제목 키워드 기반

Modelling Chemical Reaction Networks using Neural Ordinary Differential Equations

2025-02-11 · Anna C. M. Thöni, William E. Robinson, Yoram Bachrach, Wilhelm T. S. Huck 외

In chemical reaction network theory, ordinary differential equations are used to model the temporal change of chemical species concentration. As the functional form of these ordinary differential equations systems is der…

Form

Differential Equations for Continuous-Time Deep Learning

2024-01-08 · Lars Ruthotto

This short, self-contained article seeks to introduce and survey continuous-time deep learning approaches that are based on neural ordinary differential equations (neural ODEs). It primarily targets readers familiar with…

Deep LearningSurvey

Neural Ordinary Differential Equations for Learning and Extrapolating System Dynamics Across Bifurcations

2025-07-25 · Eva van Tegelen, George van Voorn, Ioannis Athanasiadis, Peter van Heijster arxiv

Forecasting system behaviour near and across bifurcations is crucial for identifying potential shifts in dynamical systems. While machine learning has recently been used to learn critical transitions and bifurcation stru…

Translation of Nagumo's Foundational Work on Barrier Functions: On the Location of Integral Curves of Ordinary Differential Equations

2024-06-25 · Marcel Menner, Eugene Lavretsky

In 1942, Prof. Mitio Nagumo published his seminal paper on the location of integral curves of ordinary differential equations. Nagumo's paper provides the foundation of the set invariance of ordinary differential equatio…

Translation

Discovering Ordinary Differential Equations with LLM-Based Qualitative and Quantitative Evaluation

2026-05-08 · Sum Kyun Song, Bong Gyun Shin, Jae Yong Lee arxiv

Discovering governing differential equations from observational data is a fundamental challenge in scientific machine learning. Existing symbolic regression approaches rely primarily on quantitative metrics; however, rea…