Enforcing Predictive Invariance across Structured Biomedical Domains
Many biochemical applications such as molecular property prediction require models to generalize beyond their training domains (environments). Moreover, natural environments in these tasks are structured, defined by complex descriptors such as molecular scaffolds or protein families. Therefore, most environments are either never seen during training, or contain only a single training example. To address these challenges, we propose a new regret minimization (RGM) algorithm and its extension for structured environments. RGM builds from invariant risk minimization (IRM) by recasting simultaneous optimality condition in terms of predictive regret, finding a representation that enables the predictor to compete against an oracle with hindsight access to held-out environments. The structured extension adaptively highlights variation due to complex environments via specialized domain perturbations. We evaluate our method on multiple applications: molecular property prediction, protein homology and stability prediction and show that RGM significantly outperforms previous state-of-the-art baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationMolecular Property PredictionPredictionProperty PredictionSimilar Papers 제목 키워드 기반
Learning Subset-Shared Invariances for Domain Generalization with Mixture-of-Experts
Domain generalization (DG) aims to learn a model from one or more source domains that generalizes to an unseen target domain without accessing target data during training. A common approach enforces invariance of represe…
Domain GeneralizationUnsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features
Inspired by recent findings that generative diffusion models learn semantically meaningful representations, we use them to discover the intrinsic hierarchical structure in biomedical 3D images using unsupervised segmenta…
SegmentationCausal and Federated Multimodal Learning for Cardiovascular Risk Prediction under Heterogeneous Populations
Cardiovascular disease (CVD) continues to be the major cause of death globally, calling for predictive models that not only handle diverse and high-dimensional biomedical signals but also maintain interpretability and pr…
Representation LearningGeneral Covariant Action Modeling: Constructing Generalized Manifolds via Spatio-Temporal Decoupling
Achieving robust generalization from limited data is a central challenge in embodied intelligence. Prevailing methods fail by regressing absolute coordinates, which violates the principle of general covariance. Fundament…
Are demographically invariant models and representations in medical imaging fair?
Medical imaging models have been shown to encode information about patient demographics such as age, race, and sex in their latent representation, raising concerns about their potential for discrimination. Here, we ask w…
counterfactualFairness