paper-with-me

Papers

PCA-Guided Quantile Sampling: Preserving Data Structure in Large-Scale Subsampling

2025-06-23 · Foo Hui-Mean, Yuan-Chin Ivan Chang

We introduce Principal Component Analysis guided Quantile Sampling (PCA QS), a novel sampling framework designed to preserve both the statistical and geometric structure of large scale datasets. Unlike conventional PCA, which reduces dimensionality at the cost of interpretability, PCA QS retains the original feature space while using leading principal components solely to guide a quantile based stratification scheme. This principled design ensures that sampling remains representative without distorting the underlying data semantics. We establish rigorous theoretical guarantees, deriving convergence rates for empirical quantiles, Kullback Leibler divergence, and Wasserstein distance, thus quantifying the distributional fidelity of PCA QS samples. Practical guidelines for selecting the number of principal components, quantile bins, and sampling rates are provided based on these results. Extensive empirical studies on both synthetic and real-world datasets show that PCA QS consistently outperforms simple random sampling, yielding better structure preservation and improved downstream model performance. Together, these contributions position PCA QS as a scalable, interpretable, and theoretically grounded solution for efficient data summarization in modern machine learning workflows.

📄 PDF Abstract BibTeX arXiv:2506.18249

Code (0)

등록된 구현이 없습니다.

Tasks

Data Summarization

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

One-Sided Quantile Coupling for Flow Matching

2026-08-02 · Jin-Young Kim, So-Yoon Cho, Hyun-Gyoon Kim arxiv

Flow Matching trains continuous-time generative models by regressing the velocity field of a probability path between a simple source distribution and a target data distribution. The coupling that pairs source and target…

Distribution-Aware Robust Bilevel Optimization: Quantile-Guided Huber Updates in Two-Timescale Stochastic Approximation

2026-06-21 · Zhiyu Li, Xi Xuan, Davide Carbone arxiv

Bilevel optimization (BLO) is fundamental to hierarchical decision-making but suffers from critical instability under heavy-tailed stochastic noise. Existing variance-reduction techniques typically rely on myopic magnitu…

Reinforcement LearningBilevel Optimization

InvarDiff: Cross-Scale Invariance Caching for Accelerated Diffusion Models

2025-11-29 · Zihao Wu arxiv

Diffusion models deliver high-fidelity synthesis but remain slow due to iterative sampling. We empirically observe there exists feature invariance in deterministic sampling, and present InvarDiff, a training-free acceler…

Deep Generative Quantile Bayes

2024-10-10 · Jungeum Kim, Percy S. Zhai, Veronika Ročková

We develop a multivariate posterior sampling procedure through deep generative quantile learning. Simulation proceeds implicitly through a push-forward mapping that can transform i.i.d. random vector samples from the pos…

ConquerNet: Convolution-Smoothed Quantile ReLU Neural Networks with Minimax Guarantees

2026-05-07 · Tianpai Luo, Fangwei Wu, Weichi Wu arxiv

Quantile regression is a fundamental tool for distributional learning but poses significant optimization challenges for deep models due to the non-smoothness of the pinball loss. We propose ConquerNet, a class of \textbf…