Late Fusion Multi-task Learning for Semiparametric Inference with Nuisance Parameters
In the age of large and heterogeneous datasets, the integration of information from diverse sources is essential to improve parameter estimation. Multi-task learning offers a powerful approach by enabling simultaneous learning across related tasks. In this work, we introduce a late fusion framework for multi-task learning with semiparametric models that involve infinite-dimensional nuisance parameters, focusing on applications such as heterogeneous treatment effect estimation across multiple data sources, including electronic health records from different hospitals or clinical trial data. Our framework is two-step: first, initial double machine-learning estimators are obtained through individual task learning; second, these estimators are adaptively aggregated to exploit task similarities while remaining robust to task-specific differences. In particular, the framework avoids individual level data sharing, preserving privacy. Additionally, we propose a novel multi-task learning method for nuisance parameter estimation, which further enhances parameter estimation when nuisance parameters exhibit similarity across tasks. We establish theoretical guarantees for the method, demonstrating faster convergence rates compared to individual task learning when tasks share similar parametric components. Extensive simulations and real data applications complement the theoretical findings of our work while highlight the effectiveness of our framework even in moderate sample sizes.
Code (0)
등록된 구현이 없습니다.
Tasks
Heterogeneous Treatment Effect EstimationMulti-Task LearningSimilar Papers 제목 키워드 기반
Semiparametric spectral modeling of the Drosophila connectome
We present semiparametric spectral modeling of the complete larval Drosophila mushroom body connectome. Motivated by a thorough exploratory data analysis of the network via Gaussian mixture modeling (GMM) in the adjacenc…
PositionStochastic Block ModelDeep Neural Networks for Estimation and Inference
We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to al…
MarketingregressionvalidSemiparametric Bayesian Inference for a Conditional Moment Equality Model
Conditional moment equality models are regularly encountered in empirical economics, yet they are difficult to estimate. These models map a conditional distribution of data to a structural parameter via the restriction t…
Bayesian InferenceUncertainty QuantificationDNA-SE: Towards Deep Neural-Nets Assisted Semiparametric Estimation
Semiparametric statistics play a pivotal role in a wide range of domains, including but not limited to missing data, causal inference, and transfer learning, to name a few. In many settings, semiparametric theory leads t…
Causal InferenceTransfer LearningCausal Inference with Corrupted Data: Measurement Error, Missing Values, Discretization, and Differential Privacy
The US Census Bureau will deliberately corrupt data sets derived from the 2020 US Census, enhancing the privacy of respondents while potentially reducing the precision of economic analysis. To investigate whether this tr…
Causal InferenceMatrix CompletionMissing Values