TLXML: Task-Level Explanation of Meta-Learning via Influence Functions
The scheme of adaptation via meta-learning is seen as an ingredient for solving the problem of data shortage or distribution shift in real-world applications, but it also brings the new risk of inappropriate updates of the model in the user environment, which increases the demand for explainability. Among the various types of XAI methods, establishing a method of explanation based on past experience in meta-learning requires special consideration due to its bi-level structure of training, which has been left unexplored. In this work, we propose influence functions for explaining meta-learning that measure the sensitivities of training tasks to adaptation and inference. We also argue that the approximation of the Hessian using the Gauss-Newton matrix resolves computational barriers peculiar to meta-learning. We demonstrate the adequacy of the method through experiments on task distinction and task distribution distinction using image classification tasks with MAML and Prototypical Network.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationMeta-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Valuing insurance against small probability risks: A meta-analysis
The demand for voluntary insurance against low-probability, high-impact risks is lower than expected. To assess the magnitude of the demand, we conduct a meta-analysis of contingent valuation studies using a dataset of e…
ManagementregressionWalk the Talk? Measuring the Faithfulness of Large Language Model Explanations
Large language models (LLMs) are capable of generating plausible explanations of how they arrived at an answer to a question. However, these explanations can misrepresent the model's "reasoning" process, i.e., they can b…
Language ModelingLanguage ModellingLarge Language ModelMedical Question Answering+1Evaluating Data Influence in Meta Learning
As one of the most fundamental models, meta learning aims to effectively address few-shot learning challenges. However, it still faces significant issues related to the training data, such as training inefficiencies due …
Bilevel OptimizationComputational EfficiencyFew-Shot LearningMeta-LearningThe effects of non-tariff measures on agri-food trade: a review and meta-analysis of empirical evidence
The increasing policy interests and the vivid academic debate on non-tariff measures (NTMs) has stimulated a growing literature on how NTMs affect agrifood trade. The empirical literature provides contrasting and heterog…
Is Meta-Path Attention an Explanation? Evidence of Alignment and Decoupling in Heterogeneous GNNs
Meta-path-based heterogeneous graph neural networks aggregate over meta-path-induced views, and their semantic-level attention over meta-path channels is widely used as a narrative for ``which semantics matter.'' We stud…