paper-with-me

Papers

Unifying and Optimizing Data Values for Selection via Sequential-Decision-Making

2025-02-06 · Hongliang Chi, Qiong Wu, Zhengyi Zhou, Jonathan Light, Emily Dodwell, Yao Ma

Data selection has emerged as a crucial downstream application of data valuation. While existing data valuation methods have shown promise in selection tasks, the theoretical foundations and full potential of using data values for selection remain largely unexplored. In this work, we first demonstrate that data values applied for selection can be naturally reformulated as a sequential-decision-making problem, where the optimal data value can be derived through dynamic programming. We show this framework unifies and reinterprets existing methods like Data Shapley through the lens of approximate dynamic programming, specifically as myopic reward function approximations to this sequential problem. Furthermore, we analyze how sequential data selection optimality is affected when the ground-truth utility function exhibits monotonic submodularity with curvature. To address the computational challenges in obtaining optimal data values, we propose an efficient approximation scheme using learned bipartite graphs as surrogate utility models, ensuring greedy selection is still optimal when the surrogate utility is correctly specified and learned. Extensive experiments demonstrate the effectiveness of our approach across diverse datasets.

📄 PDF Abstract BibTeX arXiv:2502.04554

Code (0)

등록된 구현이 없습니다.

Tasks

Data ValuationDecision MakingSequential Decision Making

Similar Papers 제목 키워드 기반

Greedy Information Projection for LLM Data Selection

2026-03-14 · Victor Ye Dong, Kuan-Yun Lee, Jiamei Shuai, Shengfei Liu 외 arxiv

We present \emph{Greedy Information Projection} (\textsc{GIP}), a principled framework for choosing training examples for large language model fine-tuning. \textsc{GIP} casts selection as maximizing mutual information be…

Mathematical Reasoning

Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks

2022-01-12 · ICLR 2022 4 · Benjamin Bowman, Guido Montufar

We study the dynamics of a neural network in function space when optimizing the mean squared error via gradient flow. We show that in the underparameterized regime the network learns eigenfunctions of an integral operato…

Selective Sequential Model Selection

2015-12-08 · William Fithian, Jonathan Taylor, Robert Tibshirani, Ryan Tibshirani

Many model selection algorithms produce a path of fits specifying a sequence of increasingly complex models. Given such a sequence and the data used to produce them, we consider the problem of choosing the least complex …

modelModel Selectionregression

On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions

2024-02-26 · Maximilian Böther, Abraham Sebastian, Pranjal Awasthi, Ana Klimovic 외

Modern datasets span billions of samples, making training on all available data infeasible. Selecting a high quality subset helps in reducing training costs and enhancing model quality. Submodularity, a discrete analogue…

Rollout Algorithms and Approximate Dynamic Programming for Bayesian Optimization and Sequential Estimation

2022-12-15 · Dimitri Bertsekas

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes…

Bayesian Optimization