Incorporating domain knowledge into neural-guided search
Many AutoML problems involve optimizing discrete objects under a black-box reward. Neural-guided search provides a flexible means of searching these combinatorial spaces using an autoregressive recurrent neural network. A major benefit of this approach is that builds up objects sequentially--this provides an opportunity to incorporate domain knowledge into the search by directly modifying the logits emitted during sampling. In this work, we formalize a framework for incorporating such in situ priors and constraints into neural-guided search, and provide sufficient conditions for enforcing constraints. We integrate several priors and constraints from existing works into this framework, propose several new ones, and demonstrate their efficacy in informing the task of symbolic regression.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLregressionSymbolic RegressionSimilar Papers 제목 키워드 기반
Incorporating domain knowledge into neural-guided search via in situ priors and constraints
Many AutoML problems involve optimizing discrete objects under a black-box reward. Neural-guided search provides a flexible means of searching these combinatorial spaces using an autoregressive recurrent neural network. …
AutoMLregressionSymbolic RegressionLearning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation
Legal case retrieval for sourcing similar cases is critical in upholding judicial fairness. Different from general web search, legal case retrieval involves processing lengthy, complex, and highly specialized legal docum…
ArticlesFairnessRetrievalPK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model
In the research of end-to-end dialogue systems, using real-world knowledge to generate natural, fluent, and human-like utterances with correct answers is crucial. However, domain-specific conversational dialogue systems …
Knowledge GraphsLanguage ModelingLanguage ModellingWorld KnowledgeTowards Automated Solution Recipe Generation for Industrial Asset Management with LLM
This study introduces a novel approach to Industrial Asset Management (IAM) by incorporating Conditional-Based Management (CBM) principles with the latest advancements in Large Language Models (LLMs). Our research introd…
Asset ManagementManagementRecipe GenerationInformed Meta-Learning
In noisy and low-data regimes prevalent in real-world applications, a key challenge of machine learning lies in effectively incorporating inductive biases that promote data efficiency and robustness. Meta-learning and in…
Meta-Learning