paper-with-me

Papers

Channel-wise Influence: Estimating Data Influence for Multivariate Time Series

2024-08-27 · Muyao Wang, Zeke Xie, Bo Chen

The influence function, a technique from robust statistics, measures the impact on model parameters or related functions when training data is removed or modified. This effective and valuable post-hoc method allows for studying the interpretability of machine learning models without requiring costly model retraining. It would provide extensions like increasing model performance, improving model generalization, and offering interpretability. Recently, Multivariate Time Series (MTS) analysis has become an important yet challenging task, attracting significant attention. However, there is no preceding research on the influence functions of MTS to shed light on the effects of modifying the channel of training MTS. Given that each channel in an MTS plays a crucial role in its analysis, it is essential to characterize the influence of different channels. To fill this gap, we propose a channel-wise influence function, which is the first method that can estimate the influence of different channels in MTS, utilizing a first-order gradient approximation that leverages the more informative average gradient of the data set. Additionally, we demonstrate how this influence function can be used to estimate the impact of a channel in MTS. Finally, we validated the accuracy and effectiveness of our influence estimation function in critical MTS analysis tasks, such as MTS anomaly detection and MTS forecasting. According to abundant experiments on real-world dataset, the original influence function performs worse than our method and even fail for the channel pruning problem, which demonstrate the superiority and necessity of channel-wise influence function in MTS analysis tasks.

📄 PDF Abstract BibTeX arXiv:2408.14763

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionTime Series

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
MTS 설명 없음

Similar Papers 제목 키워드 기반

A Study on MIMO Channel Estimation by 2D and 3D Convolutional Neural Networks

2020-11-12 · Ben Marinberg, Ariel Cohen, Eilam Ben-Dror, Haim Permuter

In this paper, we study the usage of Convolutional Neural Network (CNN) estimators for the task of Multiple-Input-Multiple-Output Orthogonal Frequency Division Multiplexing (MIMO-OFDM) Channel Estimation (CE). Specifical…

Model State Arithmetic for Machine Unlearning

2025-06-26 · Keivan Rezaei, Mehrdad Saberi, Abhilasha Ravichander, Soheil Feizi

Large language models are trained on massive corpora of web data, which may include private data, copyrighted material, factually inaccurate data, or data that degrades model performance. Eliminating the influence of suc…

Machine Unlearningmodel

Estimating Social Influence from Observational Data

2022-03-24 · Dhanya Sridhar, Caterina De Bacco, David Blei

We consider the problem of estimating social influence, the effect that a person's behavior has on the future behavior of their peers. The key challenge is that shared behavior between friends could be equally explained …

LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions

2025-05-27 · Hadi Askari, Shivanshu Gupta, Fei Wang, Anshuman Chhabra 외

Pretrained Large Language Models (LLMs) achieve strong performance across a wide range of tasks, yet exhibit substantial variability in the various layers' training quality with respect to specific downstream application…

Outlier Detection

CAFE: Conflict-Aware Feature-wise Explanations

2023-10-31 · Adam Dejl, Hamed Ayoobi, Matthew Williams, Francesca Toni

Feature attribution methods are widely used to explain neural models by determining the influence of individual input features on the models' outputs. We propose a novel feature attribution method, CAFE (Conflict-Aware F…