paper-with-me

홈 › Papers

Solvaformer: an SE(3)-equivariant graph transformer for small molecule solubility prediction

2025-11-12 · Jonathan Broadbent, Michael Bailey, Mingxuan Li, Abhishek Paul, Louis De Lescure, Paul Chauvin, Lorenzo Kogler-Anele, Yasser Jangjou, Sven Jager arxiv

Accurate prediction of small molecule solubility using material-sparing approaches is critical for accelerating synthesis and process optimization, yet experimental measurement is costly and many learning approaches either depend on quantumderived descriptors or offer limited interpretability. We introduce Solvaformer, a geometry-aware graph transformer that models solutions as multiple molecules with independent SE(3) symmetries. The architecture combines intramolecular SE(3)-equivariant attention with intermolecular scalar attention, enabling cross-molecular communication without imposing spurious relative geometry. We train Solvaformer in a multi-task setting to predict both solubility (log S) and solvation free energy, using an alternating-batch regimen that trains on quantum-mechanical data (CombiSolv-QM) and on experimental measurements (BigSolDB 2.0). Solvaformer attains the strongest overall performance among the learned models and approaches a DFT-assisted gradient-boosting baseline, while outperforming an EquiformerV2 ablation and sequence-based alternatives. In addition, token-level attention produces chemically coherent attributions: case studies recover known intra- vs. inter-molecular hydrogen-bonding patterns that govern solubility differences in positional isomers. Taken together, Solvaformer provides an accurate, scalable, and interpretable approach to solution-phase property prediction by uniting geometric inductive bias with a mixed dataset training strategy on complementary computational and experimental data.

📄 PDF Abstract BibTeX arXiv:2511.09774

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generalist Equivariant Transformer Towards 3D Molecular Interaction Learning

2023-06-02 · Xiangzhe Kong, Wenbing Huang, Yang Liu

Many processes in biology and drug discovery involve various 3D interactions between molecules, such as protein and protein, protein and small molecule, etc. Given that different molecules are usually represented in diff…

Drug Discovery

SinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems

2026-07-14 · Yuxuan Ren, Fan Yang, Jianhua Yao, Yatao Bian arxiv

Small molecules, crystals, and proteins all reduce to atoms in 3D space, yet their generative pipelines remain fragmented across domains, each with its Small molecules, crystals, and proteins all reduce to atoms in 3D sp…

An Equivariant Pretrained Transformer for Unified 3D Molecular Representation Learning

2024-02-20 · Rui Jiao, Xiangzhe Kong, Li Zhang, Ziyang Yu 외

Pretraining on a large number of unlabeled 3D molecules has showcased superiority in various scientific applications. However, prior efforts typically focus on pretraining models in a specific domain, either proteins or …

DenoisingDrug DiscoveryMolecular Property Predictionmolecular representation+3

Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphs

2022-06-23 · Yi-Lun Liao, Tess Smidt

Despite their widespread success in various domains, Transformer networks have yet to perform well across datasets in the domain of 3D atomistic graphs such as molecules even when 3D-related inductive biases like transla…

Graph AttentionGraph Neural NetworkGraph Property PredictionInitial Structure to Relaxed Energy (IS2RE), Direct+1

EquiHGNN: Scalable Rotationally Equivariant Hypergraph Neural Networks

2025-05-08 · Tien Dang, Truong-Son Hy

Molecular interactions often involve high-order relationships that cannot be fully captured by traditional graph-based models limited to pairwise connections. Hypergraphs naturally extend graphs by enabling multi-way int…