In-Context Probing Approximates Influence Function for Data Valuation
Data valuation quantifies the value of training data, and is used for data attribution (i.e., determining the contribution of training data towards model predictions), and data selection; both of which are important for curating high-quality datasets to train large language models. In our paper, we show that data valuation through in-context probing (i.e., prompting a LLM) approximates influence functions for selecting training data. We provide a theoretical sketch on this connection based on transformer models performing "implicit" gradient descent on its in-context inputs. Our empirical findings show that in-context probing and gradient-based influence frameworks are similar in how they rank training data. Furthermore, fine-tuning experiments on data selected by either method reveal similar model performance.
Code (1)
Tasks
Data ValuationSimilar Papers 제목 키워드 기반
Analyzing the Use of Influence Functions for Instance-Specific Data Filtering in Neural Machine Translation
Customer feedback can be an important signal for improving commercial machine translation systems. One solution for fixing specific translation errors is to remove the related erroneous training instances followed by re-…
image-classificationImage ClassificationMachine TranslationNMT+1On the Performance of Concept Probing: The Influence of the Data (Extended Version)
Concept probing has recently garnered increasing interest as a way to help interpret artificial neural networks, dealing both with their typically large size and their subsymbolic nature, which ultimately renders them un…
Image ClassificationLightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning
Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to…
Counterfactual Probing for the Influence of Affect and Specificity on Intergroup Bias
While existing work on studying bias in NLP focues on negative or pejorative language use, Govindarajan et al. (2023) offer a revised framing of bias in terms of intergroup social context, and its effects on language beh…
counterfactualSpecificityRevisiting the Fragility of Influence Functions
In the last few years, many works have tried to explain the predictions of deep learning models. Few methods, however, have been proposed to verify the accuracy or faithfulness of these explanations. Recently, influence …