paper-with-me

Papers

Convex Latent Effect Logit Model via Sparse and Low-rank Decomposition

2021-08-22 · Hongyuan Zhan, Kamesh Madduri, Venkataraman Shankar

In this paper, we propose a convex formulation for learning logistic regression model (logit) with latent heterogeneous effect on sub-population. In transportation, logistic regression and its variants are often interpreted as discrete choice models under utility theory (McFadden, 2001). Two prominent applications of logit models in the transportation domain are traffic accident analysis and choice modeling. In these applications, researchers often want to understand and capture the individual variation under the same accident or choice scenario. The mixed effect logistic regression (mixed logit) is a popular model employed by transportation researchers. To estimate the distribution of mixed logit parameters, a non-convex optimization problem with nested high-dimensional integrals needs to be solved. Simulation-based optimization is typically applied to solve the mixed logit parameter estimation problem. Despite its popularity, the mixed logit approach for learning individual heterogeneity has several downsides. First, the parametric form of the distribution requires domain knowledge and assumptions imposed by users, although this issue can be addressed to some extent by using a non-parametric approach. Second, the optimization problems arise from parameter estimation for mixed logit and the non-parametric extensions are non-convex, which leads to unstable model interpretation. Third, the simulation size in simulation-assisted estimation lacks finite-sample theoretical guarantees and is chosen somewhat arbitrarily in practice. To address these issues, we are motivated to develop a formulation that models the latent individual heterogeneity while preserving convexity, and avoids the need for simulation-based approximation. Our setup is based on decomposing the parameters into a sparse homogeneous component in the population and low-rank heterogeneous parts for each individual.

📄 PDF Abstract BibTeX arXiv:2108.09859

Code (0)

등록된 구현이 없습니다.

Tasks

Discrete Choice Modelsparameter estimationregression

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…

Similar Papers 제목 키워드 기반

Speeding Up Latent Variable Gaussian Graphical Model Estimation via Nonconvex Optimization

2017-12-01 · NeurIPS 2017 12 · Pan Xu, Jian Ma, Quanquan Gu

We study the estimation of the latent variable Gaussian graphical model (LVGGM), where the precision matrix is the superposition of a sparse matrix and a low-rank matrix. In order to speed up the estimation of the spars…

Speeding Up Latent Variable Gaussian Graphical Model Estimation via Nonconvex Optimizations

2017-02-28 · NeurIPS 2017 · Pan Xu, Jian Ma, Quanquan Gu

We study the estimation of the latent variable Gaussian graphical model (LVGGM), where the precision matrix is the superposition of a sparse matrix and a low-rank matrix. In order to speed up the estimation of the sparse…

Ising Models with Latent Conditional Gaussian Variables

2019-01-28 · Frank Nussbaum, Joachim Giesen

Ising models describe the joint probability distribution of a vector of binary feature variables. Typically, not all the variables interact with each other and one is interested in learning the presumably sparse network …

Exactly Robust Kernel Principal Component Analysis

2018-02-28 · Jicong Fan, Tommy W. S. Chow

Robust principal component analysis (RPCA) can recover low-rank matrices when they are corrupted by sparse noises. In practice, many matrices are, however, of high-rank and hence cannot be recovered by RPCA. We propose a…

Clustering

Fitting networks with a cancellation trick

2025-02-23 · Jiashun Jin, Jingming Wang

The degree-corrected block model (DCBM), latent space model (LSM), and $\beta$-model are all popular network models. We combine their modeling ideas and propose the logit-DCBM as a new model. Similar as the $\beta$-model…

Community Detectionparameter estimation