Feature Engineering for Predictive Modeling using Reinforcement Learning

2017-09-21 · Udayan Khurana, Horst Samulowitz, Deepak Turaga

Feature engineering is a crucial step in the process of predictive modeling. It involves the transformation of given feature space, typically using mathematical functions, with the objective of reducing the modeling error for a given target. However, there is no well-defined basis for performing effective feature engineering. It involves domain knowledge, intuition, and most of all, a lengthy process of trial and error. The human attention involved in overseeing this process significantly influences the cost of model generation. We present a new framework to automate feature engineering. It is based on performance driven exploration of a transformation graph, which systematically and compactly enumerates the space of given options. A highly efficient exploration strategy is derived through reinforcement learning on past examples.

📄 PDF Abstract BibTeX arXiv:1709.07150

Code (0)

등록된 구현이 없습니다.

Tasks

Automated Feature EngineeringEfficient ExplorationFeature Engineering reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Semantic-Guided RL for Interpretable Feature Engineering

2024-10-03 · Mohamed Bouadi, Arta Alavi, Salima Benbernou, Mourad Ouziri

The quality of Machine Learning (ML) models strongly depends on the input data, as such generating high-quality features is often required to improve the predictive accuracy. This process is referred to as Feature Engine…

Automated Feature Engineering Deep Reinforcement Learning Feature Engineering Knowledge Graphs

Interpretable Feature Engineering for Time Series Predictors using Attention Networks

2022-05-23 · Tianjie Wang, Jie Chen, Joel Vaughan, Vijayan N. Nair

Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve goo…

Feature Engineering Time Series Time Series Analysis

Learning Policy Representations in Multiagent Systems

2018-06-17 · ICML 2018 7 · Aditya Grover, Maruan Al-Shedivat, Jayesh K. Gupta, Yura Burda 외

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific pri…

Clustering continuous-control Continuous Control Deep Reinforcement Learning+5

Cluster-Specific Predictive Modeling: A Scalable Solution for Resource-Constrained Wi-Fi Controllers

2026-03-23 · Gianluca Fontanesi, Luca Barbieri, Lorenzo Galati Giordano, Alfonso Fernandez Duran 외 arxiv

This manuscript presents a comprehensive analysis of predictive modeling optimization in managed Wi-Fi networks through the integration of clustering algorithms and model evaluation techniques. The study addresses the ch…

Feature Engineering

Read, Extract, Classify: A Tool for Smarter Requirements Engineering

2026-05-11 · Paheli Bhattacharya, Manojit Chakraborty, Santhosh Kumar Arumugam, Rishabh Gupta arxiv

This paper presents the ReXCL tool, which automates the extraction and classification processes in requirements engineering, enhancing the software development life-cycle. The tool features two main modules: Extraction, …