paper-with-me

Papers

Robust high dimensional factor models with applications to statistical machine learning

2018-08-12 · Jianqing Fan, Kaizheng Wang, Yiqiao Zhong, Ziwei Zhu

Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are collected at an ever-growing scale, statistical machine learning faces some new challenges: high dimensionality, strong dependence among observed variables, heavy-tailed variables and heterogeneity. High-dimensional robust factor analysis serves as a powerful toolkit to conquer these challenges. This paper gives a selective overview on recent advance on high-dimensional factor models and their applications to statistics including Factor-Adjusted Robust Model selection (FarmSelect) and Factor-Adjusted Robust Multiple testing (FarmTest). We show that classical methods, especially principal component analysis (PCA), can be tailored to many new problems and provide powerful tools for statistical estimation and inference. We highlight PCA and its connections to matrix perturbation theory, robust statistics, random projection, false discovery rate, etc., and illustrate through several applications how insights from these fields yield solutions to modern challenges. We also present far-reaching connections between factor models and popular statistical learning problems, including network analysis and low-rank matrix recovery.

📄 PDF Abstract BibTeX arXiv:1808.03889

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningModel SelectionVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Recent Developments on Factor Models and its Applications in Econometric Learning

2020-09-21 · Jianqing Fan, Kunpeng Li, Yuan Liao

This paper makes a selective survey on the recent development of the factor model and its application on statistical learnings. We focus on the perspective of the low-rank structure of factor models, and particularly dra…

Matrix CompletionSurvey

The Nonconvex Geometry of Linear Inverse Problems

2021-01-07 · Armin Eftekhari, Peyman Mohajerin Esfahani

The gauge function, closely related to the atomic norm, measures the complexity of a statistical model, and has found broad applications in machine learning and statistical signal processing. In a high-dimensional learni…

Representation Learning: A Statistical Perspective

2019-11-26 · Jianwen Xie, Ruiqi Gao, Erik Nijkamp, Song-Chun Zhu 외

Learning representations of data is an important problem in statistics and machine learning. While the origin of learning representations can be traced back to factor analysis and multidimensional scaling in statistics, …

BIG-bench Machine LearningRepresentation Learning

Statistical Arbitrage Risk Premium by Machine Learning

2021-03-18 · Raymond C. W. Leung, Yu-Man Tam

How to hedge factor risks without knowing the identities of the factors? We first prove a general theoretical result: even if the exact set of factors cannot be identified, any risky asset can use some portfolio of simil…

BIG-bench Machine LearningPosition

Differentially Private Sliced Inverse Regression: Minimax Optimality and Algorithm

2024-01-16 · Xintao Xia, Linjun Zhang, Zhanrui Cai

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utiliz…

Dimensionality Reductionregression