paper-with-me

Papers

Late Fusion Multi-task Learning for Semiparametric Inference with Nuisance Parameters

2025-07-10 · Sohom Bhattacharya, Yongzhuo Chen, Muxuan Liang arxiv

In the age of large and heterogeneous datasets, the integration of information from diverse sources is essential to improve parameter estimation. Multi-task learning offers a powerful approach by enabling simultaneous learning across related tasks. In this work, we introduce a late fusion framework for multi-task learning with semiparametric models that involve infinite-dimensional nuisance parameters, focusing on applications such as heterogeneous treatment effect estimation across multiple data sources, including electronic health records from different hospitals or clinical trial data. Our framework is two-step: first, initial double machine-learning estimators are obtained through individual task learning; second, these estimators are adaptively aggregated to exploit task similarities while remaining robust to task-specific differences. In particular, the framework avoids individual level data sharing, preserving privacy. Additionally, we propose a novel multi-task learning method for nuisance parameter estimation, which further enhances parameter estimation when nuisance parameters exhibit similarity across tasks. We establish theoretical guarantees for the method, demonstrating faster convergence rates compared to individual task learning when tasks share similar parametric components. Extensive simulations and real data applications complement the theoretical findings of our work while highlight the effectiveness of our framework even in moderate sample sizes.

📄 PDF Abstract BibTeX arXiv:2507.07941

Code (0)

등록된 구현이 없습니다.

Tasks

Heterogeneous Treatment Effect EstimationMulti-Task Learning

Similar Papers 제목 키워드 기반

Semiparametric spectral modeling of the Drosophila connectome

2017-05-09 · Carey E. Priebe, Youngser Park, Minh Tang, Avanti Athreya 외

We present semiparametric spectral modeling of the complete larval Drosophila mushroom body connectome. Motivated by a thorough exploratory data analysis of the network via Gaussian mixture modeling (GMM) in the adjacenc…

PositionStochastic Block Model

Deep Neural Networks for Estimation and Inference

2018-09-26 · Max H. Farrell, Tengyuan Liang, Sanjog Misra

We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to al…

Marketingregressionvalid

Semiparametric Bayesian Inference for a Conditional Moment Equality Model

2024-10-21 · Christopher D. Walker

Conditional moment equality models are regularly encountered in empirical economics, yet they are difficult to estimate. These models map a conditional distribution of data to a structural parameter via the restriction t…

Bayesian InferenceUncertainty Quantification

DNA-SE: Towards Deep Neural-Nets Assisted Semiparametric Estimation

2024-08-04 · Qinshuo Liu, Zixin Wang, Xi-An Li, Xinyao Ji 외

Semiparametric statistics play a pivotal role in a wide range of domains, including but not limited to missing data, causal inference, and transfer learning, to name a few. In many settings, semiparametric theory leads t…

Causal InferenceTransfer Learning

Causal Inference with Corrupted Data: Measurement Error, Missing Values, Discretization, and Differential Privacy

2021-07-06 · Anish Agarwal, Rahul Singh

The US Census Bureau will deliberately corrupt data sets derived from the 2020 US Census, enhancing the privacy of respondents while potentially reducing the precision of economic analysis. To investigate whether this tr…

Causal InferenceMatrix CompletionMissing Values