paper-with-me

홈 › Papers

Solving Large-Scale Sparse PCA to Certifiable (Near) Optimality

2020-05-11 · Dimitris Bertsimas, Ryan Cory-Wright, Jean Pauphilet

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply certifiably optimal principal components with more than $p=100s$ of variables. By reformulating sparse PCA as a convex mixed-integer semidefinite optimization problem, we design a cutting-plane method which solves the problem to certifiable optimality at the scale of selecting k=5 covariates from p=300 variables, and provides small bound gaps at a larger scale. We also propose a convex relaxation and greedy rounding scheme that provides bound gaps of $1-2\%$ in practice within minutes for $p=100$s or hours for $p=1,000$s and is therefore a viable alternative to the exact method at scale. Using real-world financial and medical datasets, we illustrate our approach's ability to derive interpretable principal components tractably at scale.

📄 PDF Abstract BibTeX arXiv:2005.05195

Code (1)

ryancorywright/ScalableSPCA.jl 공식 구현

Tasks

Dimensionality Reduction

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

2020-09-22 · Dimitris Bertsimas, Ryan Cory-Wright, Jean Pauphilet

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisf…

TEASER: Fast and Certifiable Point Cloud Registration

2020-01-21 · Heng Yang, Jingnan Shi, Luca Carlone

We propose the first fast and certifiable algorithm for the registration of two sets of 3D points in the presence of large amounts of outlier correspondences. We first reformulate the registration problem using a Truncat…

object-detectionObject DetectionPoint Cloud RegistrationTranslation

Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness

2022-06-15 · Tianlong Chen, huan zhang, Zhenyu Zhang, Shiyu Chang 외

Certifiable robustness is a highly desirable property for adopting deep neural networks (DNNs) in safety-critical scenarios, but often demands tedious computations to establish. The main hurdle lies in the massive amount…

All-in-one: Certifiable Optimal Distributed Kalman Filter under Unknown Correlations

2021-05-31 · Eduardo Sebastián, Eduardo Montijano, Carlos Sagüés

The optimal fusion of estimates in a Distributed Kalman Filter (DKF) requires tracking of the complete network error covariance, problematic in terms of memory and communication. A scalable alternative is to fuse estimat…

All

Accelerating Certifiable Estimation with Preconditioned Eigensolvers

2022-07-12 · David M. Rosen

Convex (specifically semidefinite) relaxation provides a powerful approach to constructing robust machine perception systems, enabling the recovery of certifiably globally optimal solutions of challenging estimation prob…