paper-with-me

Papers

Selective Inference for Sparse Multitask Regression with Applications in Neuroimaging

2022-05-27 · Snigdha Panigrahi, Natasha Stewart, Chandra Sekhar Sripada, Elizaveta Levina

Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately. Despite the potential of multi-task learning to yield more powerful inference than single-task alternatives, prior work in this area has largely omitted uncertainty quantification. Our focus in this paper is a common multi-task problem in neuroimaging, where the goal is to understand the relationship between multiple cognitive task scores (or other subject-level assessments) and brain connectome data collected from imaging. We propose a framework for selective inference to address this problem, with the flexibility to: (i) jointly identify the relevant covariates for each task through a sparsity-inducing penalty, and (ii) conduct valid inference in a model based on the estimated sparsity structure. Our framework offers a new conditional procedure for inference, based on a refinement of the selection event that yields a tractable selection-adjusted likelihood. This gives an approximate system of estimating equations for maximum likelihood inference, solvable via a single convex optimization problem, and enables us to efficiently form confidence intervals with approximately the correct coverage. Applied to both simulated data and data from the Adolescent Brain Cognitive Development (ABCD) study, our selective inference methods yield tighter confidence intervals than commonly used alternatives, such as data splitting. We also demonstrate through simulations that multi-task learning with selective inference can more accurately recover true signals than single-task methods.

📄 PDF Abstract BibTeX arXiv:2205.14220

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task LearningregressionUncertainty Quantification

Similar Papers 제목 키워드 기반

Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning

2024-07-01 · Yixiao Wang, Yifei Zhang, Mingxiao Huo, Ran Tian 외

The increasing complexity of tasks in robotics demands efficient strategies for multitask and continual learning. Traditional models typically rely on a universal policy for all tasks, facing challenges such as high comp…

Continual LearningMixture-of-Experts

Optimal Multitask Linear Regression and Contextual Bandits under Sparse Heterogeneity

2023-06-09 · Xinmeng Huang, Kan Xu, Donghwan Lee, Hamed Hassani 외

Large and complex datasets are often collected from several, possibly heterogeneous sources. Multitask learning methods improve efficiency by leveraging commonalities across datasets while accounting for possible differe…

Multi-Armed Banditsregression

Pruning-Aware Merging for Efficient Multitask Inference

2019-05-23 · Xiaoxi He, Dawei Gao, Zimu Zhou, Yongxin Tong 외

Many mobile applications demand selective execution of multiple correlated deep learning inference tasks on resource-constrained platforms. Given a set of deep neural networks, each pre-trained for a single task, it is d…

Network Pruning

Approximate Post-Selective Inference for Regression with the Group LASSO

2020-12-31 · Snigdha Panigrahi, Peter W. MacDonald, Daniel Kessler

After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection…

regressionSelection biasSparse Learning

Hierarchical Sparse Bayesian Multitask Model with Scalable Inference for Microbiome Analysis

2025-02-04 · Haonan Zhu, Andre R. Goncalves, Camilo Valdes, Hiranmayi Ranganathan 외

This paper proposes a hierarchical Bayesian multitask learning model that is applicable to the general multi-task binary classification learning problem where the model assumes a shared sparsity structure across differen…

Binary ClassificationUncertainty QuantificationVariational Inference