Incorporating Domain Knowledge into Deep Neural Networks
We present a survey of ways in which domain-knowledge has been included when constructing models with neural networks. The inclusion of domain-knowledge is of special interest not just to constructing scientific assistants, but also, many other areas that involve understanding data using human-machine collaboration. In many such instances, machine-based model construction may benefit significantly from being provided with human-knowledge of the domain encoded in a sufficiently precise form. This paper examines two broad approaches to encode such knowledge--as logical and numerical constraints--and describes techniques and results obtained in several sub-categories under each of these approaches.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Incorporating Medical Knowledge to Transformer-based Language Models for Medical Dialogue Generation
Medical dialogue systems have the potential to assist doctors in expanding access to medical care, improving the quality of patient experiences, and lowering medical expenses. The computational methods are still in their…
Dialogue GenerationMedical DiagnosisIncorporating domain knowledge into neural-guided search
Many AutoML problems involve optimizing discrete objects under a black-box reward. Neural-guided search provides a flexible means of searching these combinatorial spaces using an autoregressive recurrent neural network. …
AutoMLregressionSymbolic RegressionIntegrating knowledge bases to improve coreference and bridging resolution for the chemical domain
Resolving coreference and bridging relations in chemical patents is important for better understanding the precise chemical process, where chemical domain knowledge is very critical. We proposed an approach incorporating…
Chemical ProcessMulti-Task LearningIncorporating domain knowledge into neural-guided search via in situ priors and constraints
Many AutoML problems involve optimizing discrete objects under a black-box reward. Neural-guided search provides a flexible means of searching these combinatorial spaces using an autoregressive recurrent neural network. …
AutoMLregressionSymbolic RegressionSystematic Knowledge Injection into Large Language Models via Diverse Augmentation for Domain-Specific RAG
Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowled…
RAGRetrievalRetrieval-augmented Generation