Invariance assumptions for class distribution estimation
We study the problem of class distribution estimation under dataset shift. On the training dataset, both features and class labels are observed while on the test dataset only the features can be observed. The task then is the estimation of the distribution of the class labels, i.e. the estimation of the class prior probabilities, in the test dataset. Assumptions of invariance between the training joint distribution of features and labels and the test distribution can considerably facilitate this task. We discuss the assumptions of covariate shift, factorizable joint shift, and sparse joint shift and their implications for class distribution estimation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Predicting Out-of-Domain Generalization with Neighborhood Invariance
Developing and deploying machine learning models safely depends on the ability to characterize and compare their abilities to generalize to new environments. Although recent work has proposed a variety of methods that ca…
Data AugmentationDomain Generalizationimage-classificationImage Classification+2Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization
The invariance principle from causality is at the heart of notable approaches such as invariant risk minimization (IRM) that seek to address out-of-distribution (OOD) generalization failures. Despite the promising theory…
Out-of-Distribution GeneralizationregressionDensity estimation for shift-invariant multidimensional distributions
We study density estimation for classes of shift-invariant distributions over $\mathbb{R}^d$. A multidimensional distribution is "shift-invariant" if, roughly speaking, it is close in total variation distance to a small …
Density EstimationDomain Generalization -- A Causal Perspective
Machine learning models rely on various assumptions to attain high accuracy. One of the preliminary assumptions of these models is the independent and identical distribution, which suggests that the train and test data a…
Data AugmentationDomain GeneralizationRepresentation LearningDomain Generalization through the Lens of Angular Invariance
Domain generalization (DG) aims at generalizing a classifier trained on multiple source domains to an unseen target domain with domain shift. A common pervasive theme in existing DG literature is domain-invariant represe…
Domain GeneralizationRepresentation Learning