Interpretable Feature Engineering for Time Series Predictors using Attention Networks

2022-05-23 · Tianjie Wang, Jie Chen, Joel Vaughan, Vijayan N. Nair

Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive performance. The customized attention layer explicitly uses multiplicative interactions and builds feature-engineering heads that capture temporal dynamics in a parsimonious manner. Convolutional layers are used to combine multivariate time series. We also discuss methods for handling static covariates in the modeling process. Visualization and explanation tools are used to interpret the results and explain the relationship between the inputs and the extracted features. Both simulation and real dataset are used to illustrate the usefulness of the methodology. Keyword: Attention heads, Deep neural networks, Interpretable feature engineering

📄 PDF Abstract BibTeX arXiv:2205.12723

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringTime SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Automatic Feature Engineering for Time Series Classification: Evaluation and Discussion

2023-08-02 · Aurélien Renault, Alexis Bondu, Vincent Lemaire, Dominique Gay

Time Series Classification (TSC) has received much attention in the past two decades and is still a crucial and challenging problem in data science and knowledge engineering. Indeed, along with the increasing availabilit…

Descriptive Feature Engineering Time Series Time Series Classification

Interpreting Machine Learning Models for Room Temperature Prediction in Non-domestic Buildings

2021-11-23 · Jianqiao Mao, Grammenos Ryan

An ensuing challenge in Artificial Intelligence (AI) is the perceived difficulty in interpreting sophisticated machine learning models, whose ever-increasing complexity makes it hard for such models to be understood, tru…

BIG-bench Machine Learning Decision Making Feature Engineering Interpretable Machine Learning+1

EAMDrift: An interpretable self retrain model for time series

2023-05-31 · Gonçalo Mateus, Cláudia Soares, João Leitão, António Rodrigues

The use of machine learning for time series prediction has become increasingly popular across various industries thanks to the availability of time series data and advancements in machine learning algorithms. However, tr…

Time Series Time Series Forecasting Time Series Prediction

When, How Long and How Much? Interpretable Neural Networks for Time Series Regression by Learning to Mask and Aggregate

2025-12-03 · Florent Forest, Amaury Wei, Olga Fink arxiv

Time series extrinsic regression (TSER) refers to the task of predicting a continuous target variable from an input time series. It appears in many domains, including healthcare, finance, environmental monitoring, and en…

Time Series Regression

ELATE: Evolutionary Language model for Automated Time-series Engineering

2025-08-20 · Andrew Murray, Danial Dervovic, Michael Cashmore arxiv

Time-series prediction involves forecasting future values using machine learning models. Feature engineering, whereby existing features are transformed to make new ones, is critical for enhancing model performance, but i…

Feature Engineering Feature Importance