Quantile universal threshold: model selection at the detection edge for high-dimensional linear regression
To estimate a sparse linear model from data with Gaussian noise, consilience from lasso and compressed sensing literatures is that thresholding estimators like lasso and the Dantzig selector have the ability in some situations to identify with high probability part of the significant covariates asymptotically, and are numerically tractable thanks to convexity. Yet, the selection of a threshold parameter $\lambda$ remains crucial in practice. To that aim we propose Quantile Universal Thresholding, a selection of $\lambda$ at the detection edge. We show with extensive simulations and real data that an excellent compromise between high true positive rate and low false discovery rate is achieved, leading also to good predictive risk.
Code (0)
등록된 구현이 없습니다.
Tasks
compressed sensingModel SelectionregressionSimilar Papers 제목 키워드 기반
Model selection with lasso-zero: adding straw to the haystack to better find needles
The high-dimensional linear model $y = X \beta^0 + \epsilon$ is considered and the focus is put on the problem of recovering the support $S^0$ of the sparse vector $\beta^0.$ We introduce Lasso-Zero, a new $\ell_1$-based…
Model SelectionOn the Convergence of DP-SGD with Adaptive Clipping
Stochastic Gradient Descent (SGD) with gradient clipping is a powerful technique for enabling differentially private optimization. Although prior works extensively investigated clipping with a constant threshold, private…
Finite sample guarantees for quantile estimation: An application to detector threshold tuning
In threshold-based anomaly detection, we want to tune the threshold of a detector to achieve an acceptable false alarm rate. However, tuning the threshold is often a non-trivial task due to unknown detector output distri…
Anomaly DetectionQuantile Transfer for Reliable Operating Point Selection in Visual Place Recognition
Visual Place Recognition (VPR) is a key component for localization in Global Navigation Satellite System (GNSS)-denied environments, but its performance critically depends on selecting an image matching threshold (operat…
Visual Place RecognitionImage MatchingAn Efficient Edge Detection Approach to Provide Better Edge Connectivity for Image Analysis
An edge detection is important for its reliability and security which delivers a better understanding of object recognition in the applications of computer vision, such as pedestrian detection, face detection, and video …
Edge DetectionFace DetectionObject RecognitionPedestrian Detection