Semantic-Guided RL for Interpretable Feature Engineering
The quality of Machine Learning (ML) models strongly depends on the input data, as such generating high-quality features is often required to improve the predictive accuracy. This process is referred to as Feature Engineering (FE). However, since manual feature engineering is time-consuming and requires case-by-case domain knowledge, Automated Feature Engineering (AutoFE) is crucial. A major challenge that remains is to generate interpretable features. To tackle this problem, we introduce SMART, a hybrid approach that uses semantic technologies to guide the generation of interpretable features through a two-step process: Exploitation and Exploration. The former uses Description Logics (DL) to reason on the semantics embedded in Knowledge Graphs (KG) to infer domain-specific features, while the latter exploits the knowledge graph to conduct a guided exploration of the search space through Deep Reinforcement Learning (DRL). Our experiments on public datasets demonstrate that SMART significantly improves prediction accuracy while ensuring a high level of interpretability.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Feature EngineeringDeep Reinforcement LearningFeature EngineeringKnowledge GraphsSimilar Papers 제목 키워드 기반
Bridging Expert Knowledge and Automated Feature Engineering via Self-Evolution
In high-stakes settings such as brand compliance, clinical care, and content moderation, machine learning cannot be deployed as opaque oracles: practitioners inspect the features driving model decisions, and models must …
Feature EngineeringThe Semantic Architect: How FEAML Bridges Structured Data and LLMs for Multi-Label Tasks
Existing feature engineering methods based on large language models (LLMs) have not yet been applied to multi-label learning tasks. They lack the ability to model complex label dependencies and are not specifically adapt…
Multi-Label ClassificationMulti-Label LearningFeature EngineeringCode GenerationInterpretable Fuzzy Systems For Forward Osmosis Desalination
Preserving interpretability in fuzzy rule-based systems (FRBS) is vital for water treatment, where decisions impact public health. While structural interpretability has been addressed using multi-objective algorithms, se…
Feature EngineeringInterpretable Set Functions
We propose learning flexible but interpretable functions that aggregate a variable-length set of permutation-invariant feature vectors to predict a label. We use a deep lattice network model so we can architect the model…
Feature Engineering for Agents: An Adaptive Cognitive Architecture for Interpretable ML Monitoring
Monitoring Machine Learning (ML) models in production environments is crucial, yet traditional approaches often yield verbose, low-interpretability outputs that hinder effective decision-making. We propose a cognitive ar…
Feature Engineering