paper-with-me

홈 › Papers

Geometric Data Valuation via Leverage Scores

2025-11-03 · Rodrigo Mendoza-Smith arxiv

Shapley data valuation provides a principled, axiomatic framework for assigning importance to individual datapoints, and has gained traction in dataset curation, pruning, and pricing. However, it is a combinatorial measure that requires evaluating marginal utility across all subsets of the data, making it computationally infeasible at scale. We propose a geometric alternative based on statistical leverage scores, which quantify each datapoint's structural influence in the representation space by measuring how much it extends the span of the dataset and contributes to the effective dimensionality of the training problem. We show that our scores satisfy the dummy, efficiency, and symmetry axioms of Shapley valuation and that extending them to \emph{ridge leverage scores} yields strictly positive marginal gains that connect naturally to classical A- and D-optimal design criteria. We further show that training on a leverage-sampled subset produces a model whose parameters and predictive risk are within $O(\varepsilon)$ of the full-data optimum, thereby providing a rigorous link between data valuation and downstream decision quality. Finally, we conduct an active learning experiment in which we empirically demonstrate that ridge-leverage sampling outperforms standard baselines without requiring access gradients or backward passes.

📄 PDF Abstract BibTeX arXiv:2511.02100

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Similar Papers 제목 키워드 기반

Generalized Leverage Scores: Geometric Interpretation and Applications

2022-06-16 · Bruno Ordozgoiti, Antonis Matakos, Aristides Gionis

In problems involving matrix computations, the concept of leverage has found a large number of applications. In particular, leverage scores, which relate the columns of a matrix to the subspaces spanned by its leading si…

Geometric Data Augmentations to Mitigate Distribution Shifts in Pollen Classification from Microscopic Images

2023-11-18 · Nam Cao, Olga Saukh

Distribution shifts are characterized by differences between the training and test data distributions. They can significantly reduce the accuracy of machine learning models deployed in real-world scenarios. This paper ex…

DiversityImage Augmentation

BoRP: Bootstrapped Regression Probing for Scalable and Human-Aligned LLM Evaluation

2026-01-26 · Peng Sun, Xiangyu Zhang, Duan Wu, Lu Tan 외 arxiv

Accurate evaluation of user satisfaction is critical for iterative development of conversational AI. However, for open-ended assistants, traditional A/B testing lacks reliable metrics: explicit feedback is sparse, while …

GeoDetect: Geometric Adversarial Detection for VLPs

2026-07-16 · Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie, James Bailey 외 arxiv

Vision-language pre-trained models (VLPs) are widely used in real-world applications. However, they remain vulnerable to adversarial attacks. Although adversarial detection methods have demonstrated success in single-mod…

When Attention Collapses: Stage-Aware Visual Token Pruning from Structure to Semantics

2026-06-02 · Jiahui Wang, Kai Zhang, Mai Han, Huanghe Zhang arxiv

Vision-Language Models (VLMs) have demonstrated remarkable capabilities but suffer from significant computational overhead during inference. While visual token pruning offers a promising solution, existing methods predom…