MLDGG: Meta-Learning for Domain Generalization on Graphs
Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods often rely on static encoders directly applied to the target domain, constraining its flexible adaptability. In contrast to conventional methodologies, which concentrate on developing specific generalized models, our framework, MLDGG, endeavors to achieve adaptable generalization across diverse domains by integrating cross-multi-domain meta-learning with structure learning and semantic identification. Initially, it introduces a generalized structure learner to mitigate the adverse effects of task-unrelated edges, enhancing the comprehensiveness of representations learned by Graph Neural Networks (GNNs) while capturing shared structural information across domains. Subsequently, a representation learner is designed to disentangle domain-invariant semantic and domain-specific variation information in node embedding by leveraging causal reasoning for semantic identification, further enhancing generalization. In the context of meta-learning, meta-parameters for both learners are optimized to facilitate knowledge transfer and enable effective adaptation to graphs through fine-tuning within the target domains, where target graphs are inaccessible during training. Our empirical results demonstrate that MLDGG surpasses baseline methods, showcasing its effectiveness in three different distribution shift settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain GeneralizationMeta-LearningTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning to Order: Task Sequencing as In-Context Optimization
Task sequencing (TS) is one of the core open problems in Deep Learning, arising in a plethora of real-world domains, from robotic assembly lines to autonomous driving. Unfortunately, prior work has not convincingly demon…
Autonomous DrivingMetabolic graphs, LIFE method and the modeling of drug action on Mycobacterium tuberculosis
This paper serves as a framework for designing advanced models for drug action on metabolism. Drug treatment may affect metabolism by either enhancing or inhibiting metabolic reactions comprising a metabolic network. We …
Graph Meta Learning via Local Subgraphs
Prevailing methods for graphs require abundant label and edge information for learning. When data for a new task are scarce, meta-learning can learn from prior experiences and form much-needed inductive biases for fast a…
Few-Shot LearningMeta-LearningToward Improved Generalization: Meta Transfer of Self-supervised Knowledge on Graphs
Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many task…
Meta-LearningRepresentation LearningSelf-Supervised LearningTransfer LearningMeta-forests: Domain generalization on random forests with meta-learning
Domain generalization is a popular machine learning technique that enables models to perform well on the unseen target domain, by learning from multiple source domains. Domain generalization is useful in cases where data…
Domain GeneralizationMeta-LearningObjectObject Recognition