Interpretable QSPR Modeling using Recursive Feature Machines and Multi-scale Fingerprints
This study pioneers the application of Recursive Feature Machines (RFM) in QSPR modeling, introducing a tailored feature importance analysis approach to enhance interpretability. By leveraging deep feature learning through AGOP, RFM achieves state-of-the-art (SOTA) results in predicting molecular properties, as demonstrated through solubility prediction across nine benchmark datasets. To capture a wide array of structural information, we employ diverse molecular representations, including MACCS keys, Morgan fingerprints, and a custom multi-scale hybrid fingerprint (HF) derived from global descriptors and SMILES local fragmentation techniques. Notably, the HF offers significant advantages over MACCS and Morgan fingerprints in revealing structural determinants of molecular properties. The feature importance analysis in RFM provides robust local and global explanations, effectively identifying structural features that drive molecular behavior and offering valuable insights for drug development. Additionally, RFM demonstrates strong redundancy-filtering abilities, as model performance remains stable even after removing redundant features within custom fingerprints. Importantly, RFM introduces the deep feature learning capabilities of the average gradient outer product (AGOP) matrix into ultra-fast kernel machine learning, to imbue kernel machines with interpretable deep feature learning capabilities. We extend this approach beyond the Laplace Kernel to the Matern, Rational Quadratic, and Gaussian kernels, to find that the Matern and Laplace kernels deliver the best performance, thus reinforcing the flexibility and effectiveness of AGOP in RFM. Experimental results show that RFM-HF surpasses both traditional machine learning models and advanced graph neural networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature ImportanceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Learning Based Regression and Multi-class Models for Acute Oral Toxicity Prediction with Automatic Chemical Feature Extraction
For quantitative structure-property relationship (QSPR) studies in chemoinformatics, it is important to get interpretable relationship between chemical properties and chemical features. However, the predictive power and …
Steering Autoregressive Music Generation with Recursive Feature Machines
Controllable music generation remains a significant challenge, with existing methods often requiring model retraining or introducing audible artifacts. We introduce MusicRFM, a framework that adapts Recursive Feature Mac…
Music GenerationTab-TRM: Tiny Recursive Model for Insurance Pricing on Tabular Data
We introduce Tab-TRM (Tabular-Tiny Recursive Model), a network architecture that adapts the recursive latent reasoning paradigm of Tiny Recursive Models (TRMs) to insurance modeling. Drawing inspiration from both the Hie…
On Feature Scaling of Recursive Feature Machines
In this technical report, we explore the behavior of Recursive Feature Machines (RFMs), a type of novel kernel machine that recursively learns features via the average gradient outer product, through a series of experime…
Towards Environment-Sensitive Molecular Inference via Mixed Integer Linear Programming
Traditional QSAR/QSPR and inverse QSAR/QSPR methods often assume that chemical properties are dictated by single molecules, overlooking the influence of molecular interactions and environmental factors. In this paper, we…