paper-with-me

Papers

Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions

2022-07-11 · Heiner Kremer, Jia-Jie Zhu, Krikamol Muandet, Bernhard Schölkopf

Important problems in causal inference, economics, and, more generally, robust machine learning can be expressed as conditional moment restrictions, but estimation becomes challenging as it requires solving a continuum of unconditional moment restrictions. Previous works addressed this problem by extending the generalized method of moments (GMM) to continuum moment restrictions. In contrast, generalized empirical likelihood (GEL) provides a more general framework and has been shown to enjoy favorable small-sample properties compared to GMM-based estimators. To benefit from recent developments in machine learning, we provide a functional reformulation of GEL in which arbitrary models can be leveraged. Motivated by a dual formulation of the resulting infinite dimensional optimization problem, we devise a practical method and explore its asymptotic properties. Finally, we provide kernel- and neural network-based implementations of the estimator, which achieve state-of-the-art empirical performance on two conditional moment restriction problems.

📄 PDF Abstract BibTeX arXiv:2207.04771

Code (1)

heinerkremer/functional-gel 공식 구현 pytorch

Tasks

BIG-bench Machine LearningCausal Inference

Similar Papers 제목 키워드 기반

Estimation Beyond Data Reweighting: Kernel Method of Moments

2023-05-18 · Heiner Kremer, Yassine Nemmour, Bernhard Schölkopf, Jia-Jie Zhu

Moment restrictions and their conditional counterparts emerge in many areas of machine learning and statistics ranging from causal inference to reinforcement learning. Estimators for these tasks, generally called methods…

Causal Inference

Observational nonidentifiability, generalized likelihood and free energy

2020-02-18 · A. E. Allahverdyan

We study the parameter estimation problem in mixture models with observational nonidentifiability: the full model (also containing hidden variables) is identifiable, but the marginal (observed) model is not. Hence global…

parameter estimation

Generalized Precision Matrix for Scalable Estimation of Nonparametric Markov Networks

2023-05-19 · Yujia Zheng, Ignavier Ng, Yewen Fan, Kun Zhang

A Markov network characterizes the conditional independence structure, or Markov property, among a set of random variables. Existing work focuses on specific families of distributions (e.g., exponential families) and/or …

Artificial neural networks and time series of counts: A class of nonlinear INGARCH models

2023-04-03 · Malte Jahn

Time series of counts are frequently analyzed using generalized integer-valued autoregressive models with conditional heteroskedasticity (INGARCH). These models employ response functions to map a vector of past observati…

Time Series

Preventing Oversmoothing in VAE via Generalized Variance Parameterization

2021-02-17 · Yuhta Takida, Wei-Hsiang Liao, Chieh-Hsin Lai, Toshimitsu Uesaka 외

Variational autoencoders (VAEs) often suffer from posterior collapse, which is a phenomenon in which the learned latent space becomes uninformative. This is often related to the hyperparameter resembling the data varianc…

Decoder