Generalizing to Evolving Domains with Latent Structure-Aware Sequential Autoencoder
Domain generalization aims to improve the generalization capability of machine learning systems to out-of-distribution (OOD) data. Existing domain generalization techniques embark upon stationary and discrete environments to tackle the generalization issue caused by OOD data. However, many real-world tasks in non-stationary environments (e.g. self-driven car system, sensor measures) involve more complex and continuously evolving domain drift, which raises new challenges for the problem of domain generalization. In this paper, we formulate the aforementioned setting as the problem of evolving domain generalization. Specifically, we propose to introduce a probabilistic framework called Latent Structure-aware Sequential Autoencoder (LSSAE) to tackle the problem of evolving domain generalization via exploring the underlying continuous structure in the latent space of deep neural networks, where we aim to identify two major factors namely covariate shift and concept shift accounting for distribution shift in non-stationary environments. Experimental results on both synthetic and real-world datasets show that LSSAE can lead to superior performances based on the evolving domain generalization setting.
Code (1)
Tasks
Domain GeneralizationEvolving Domain GeneralizationSimilar Papers 제목 키워드 기반
Generalizing across Temporal Domains with Koopman Operators
In the field of domain generalization, the task of constructing a predictive model capable of generalizing to a target domain without access to target data remains challenging. This problem becomes further complicated wh…
Domain GeneralizationGeneralization BoundsDynamic Schema Graph Fusion Network for Multi-Domain Dialogue State Tracking
Dialogue State Tracking (DST) aims to keep track of users' intentions during the course of a conversation. In DST, modelling the relations among domains and slots is still an under-studied problem. Existing approaches th…
DecoderDialogue State TrackingMulti-domain Dialogue State TrackingTransfer LearningDynamic Schema Graph Fusion Network for Multi-Domain Dialogue State Tracking
Dialogue State Tracking (DST) aims to keep track of users' intentions during the course of a conversation. In DST, modelling the relations among domains and slots is still an under-studied problem. Existing approaches th…
DecoderDialogue State TrackingMulti-domain Dialogue State TrackingTransfer LearningTime-Aware Latent Space Bayesian Optimization
Latent-space Bayesian optimization (LSBO) extends Bayesian optimization to structured domains, such as molecular design, by searching in the continuous latent space of a generative model. However, most LSBO methods assum…
A Scalable Cross-Domain Event Extraction System via a Unified Generative Training Framework
Event extraction is fundamental to information extraction. Prior approaches often separate event detection and argument extraction or depend on dataset-specific designs, limiting scalability and cross-domain generalizati…
Information ExtractionDomain GeneralizationEvent Extraction