Strong identifiability and parameter learning in regression with heterogeneous response
Mixtures of regression are a powerful class of models for regression learning with respect to a highly uncertain and heterogeneous response variable of interest. In addition to being a rich predictive model for the response given some covariates, the parameters in this model class provide useful information about the heterogeneity in the data population, which is represented by the conditional distributions for the response given the covariates associated with a number of distinct but latent subpopulations. In this paper, we investigate conditions of strong identifiability, rates of convergence for conditional density and parameter estimation, and the Bayesian posterior contraction behavior arising in finite mixture of regression models, under exact-fitted and over-fitted settings and when the number of components is unknown. This theory is applicable to common choices of link functions and families of conditional distributions employed by practitioners. We provide simulation studies and data illustrations, which shed some light on the parameter learning behavior found in several popular regression mixture models reported in the literature.
Code (0)
등록된 구현이 없습니다.
Tasks
parameter estimationregressionSimilar Papers 제목 키워드 기반
Non-Identifiability in Network Autoregressions
We study identifiability of the parameters in autoregressions defined on a network. Most identification conditions that are available for these models either rely on the network being observed repeatedly, are only suffic…
Frequency Domain Identifiability and Sloppiness of Descriptor Systems with an LFT Structure
Identifiability and sloppiness are investigated in this paper for the parameters of a descriptor system based on its frequency response samples. Two metrics are suggested respectively for measuring absolute and relative …
Multivariate response and parsimony for Gaussian cluster-weighted models
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsim…
Clusteringparameter estimationregressionLASSO-ODE: A framework for mechanistic model identifiability and selection in disease transmission modeling
To be fully useful for public health practice, models for epidemic response must be able to do more than predict -- it is also important to incorporate the mechanisms underlying transmission dynamics to enable policymake…
Model Selectionparameter estimationTime SeriesTime Series AnalysisBeyond Convergence: Identifiability of Machine Learning and Deep Learning Models
Machine learning (ML) and deep learning models are extensively used for parameter optimization and regression problems. However, not all inverse problems in ML are ``identifiable,'' indicating that model parameters may n…
Deep Learningparameter estimation