Statistical applications of contrastive learning
The likelihood function plays a crucial role in statistical inference and experimental design. However, it is computationally intractable for several important classes of statistical models, including energy-based models and simulator-based models. Contrastive learning is an intuitive and computationally feasible alternative to likelihood-based learning. We here first provide an introduction to contrastive learning and then show how we can use it to derive methods for diverse statistical problems, namely parameter estimation for energy-based models, Bayesian inference for simulator-based models, as well as experimental design.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceContrastive LearningExperimental Designparameter estimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fairness-Aware Node Representation Learning
Node representation learning has demonstrated its effectiveness for various applications on graphs. Particularly, recent developments in contrastive learning have led to promising results in unsupervised node representat…
Contrastive LearningFairnessNode ClassificationRepresentation LearningStatistical Consistency and Generalization of Contrastive Representation Learning
Contrastive representation learning (CRL) underpins many modern foundation models. Despite recent theoretical progress, existing analyses suffer from several key limitations: (i) the statistical consistency of CRL remain…
Representation LearningContrastive Domain Adaptation for Time-Series via Temporal Mixup
Unsupervised Domain Adaptation (UDA) has emerged as a powerful solution for the domain shift problem via transferring the knowledge from a labeled source domain to a shifted unlabeled target domain. Despite the prevalenc…
Contrastive LearningDomain AdaptationTime SeriesTime Series Analysis+1Contrastive Learning from Pairwise Measurements
Learning from pairwise measurements naturally arises from many applications, such as rank aggregation, ordinal embedding, and crowdsourcing. However, most existing models and algorithms are susceptible to potential model…
Contrastive LearningData AugmentationTight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization
Successful applications of InfoNCE and its variants have popularized the use of contrastive variational mutual information (MI) estimators in machine learning. While featuring superior stability, these estimators crucial…
Mutual Information Estimation