paper-with-me

홈 › Papers

Automatic and Structure-Aware Sparsification of Hybrid Neural ODEs

2025-05-25 · Bob Junyi Zou, Lu Tian

Hybrid neural ordinary differential equations (neural ODEs) integrate mechanistic models with neural ODEs, offering strong inductive bias and flexibility, and are particularly advantageous in data-scarce healthcare settings. However, excessive latent states and interactions from mechanistic models can lead to training inefficiency and over-fitting, limiting practical effectiveness of hybrid neural ODEs. In response, we propose a new hybrid pipeline for automatic state selection and structure optimization in mechanistic neural ODEs, combining domain-informed graph modifications with data-driven regularization to sparsify the model for improving predictive performance and stability while retaining mechanistic plausibility. Experiments on synthetic and real-world data show improved predictive performance and robustness with desired sparsity, establishing an effective solution for hybrid model reduction in healthcare applications.

📄 PDF Abstract BibTeX arXiv:2505.18996

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive Bias

Similar Papers 제목 키워드 기반

Theoretically Better and Numerically Faster Distributed Optimization with Smoothness-Aware Quantization Techniques

2021-06-07 · Bokun Wang, Mher Safaryan, Peter Richtárik

To address the high communication costs of distributed machine learning, a large body of work has been devoted in recent years to designing various compression strategies, such as sparsification and quantization, and opt…

BIG-bench Machine LearningDistributed OptimizationQuantization

Gradient Sparification for Asynchronous Distributed Training

2019-10-24 · Zijie Yan

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging info…

Federated LearningStochastic Optimization

Representation Sparsification with Hybrid Thresholding for Fast SPLADE-based Document Retrieval

2023-06-20 · Yifan Qiao, Yingrui Yang, Shanxiu He, Tao Yang

Learned sparse document representations using a transformer-based neural model has been found to be attractive in both relevance effectiveness and time efficiency. This paper describes a representation sparsification sch…

Retrieval

Connectivity-Guided Sparsification of 2-FWL GNNs: Preserving Full Expressivity with Improved Efficiency

2025-11-16 · Rongqin Chen, Fan Mo, Pak Lon Ip, Shenghui Zhang 외 arxiv

Higher-order Graph Neural Networks (HOGNNs) based on the 2-FWL test achieve superior expressivity by modeling 2- and 3-node interactions, but at $\mathcal{O}(n^3)$ computational cost. However, this computational burden i…

Large Hybrid Time-Varying Parameter VARs

2022-01-18 · Joshua C. C. Chan

Time-varying parameter VARs with stochastic volatility are routinely used for structural analysis and forecasting in settings involving a few endogenous variables. Applying these models to high-dimensional datasets has p…