Knowledge-Based Learning through Feature Generation
Machine learning algorithms have difficulties to generalize over a small set of examples. Humans can perform such a task by exploiting vast amount of background knowledge they possess. One method for enhancing learning algorithms with external knowledge is through feature generation. In this paper, we introduce a new algorithm for generating features based on a collection of auxiliary datasets. We assume that, in addition to the training set, we have access to additional datasets. Unlike the transfer learning setup, we do not assume that the auxiliary datasets represent learning tasks that are similar to our original one. The algorithm finds features that are common to the training set and the auxiliary datasets. Based on these features and examples from the auxiliary datasets, it induces predictors for new features from the auxiliary datasets. The induced predictors are then added to the original training set as generated features. Our method was tested on a variety of learning tasks, including text classification and medical prediction, and showed a significant improvement over using just the given features.
Code (0)
등록된 구현이 없습니다.
Tasks
text-classificationText ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
Information for Conversation Generation: Proposals Utilising Knowledge Graphs
LLMs are frequently used tools for conversational generation. Without additional information LLMs can generate lower quality responses due to lacking relevant content and hallucinations, as well as the perception of poor…
Knowledge Graph EmbeddingsKnowledge GraphsResponse GenerationSemantic-Guided RL for Interpretable Feature Engineering
The quality of Machine Learning (ML) models strongly depends on the input data, as such generating high-quality features is often required to improve the predictive accuracy. This process is referred to as Feature Engine…
Automated Feature EngineeringDeep Reinforcement LearningFeature EngineeringKnowledge GraphsVideoRAG: Retrieval-Augmented Generation with Extreme Long-Context Videos
Retrieval-Augmented Generation (RAG) has demonstrated remarkable success in enhancing Large Language Models (LLMs) through external knowledge integration, yet its application has primarily focused on textual content, lea…
Knowledge GraphsRAGRetrievalRetrieval-augmented Generation+1CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation
Commonsense knowledge is crucial to many natural language processing tasks. Existing works usually incorporate graph knowledge with conventional graph neural networks (GNNs), resulting in a sequential pipeline that compa…
Dialogue GenerationGraph AttentionKnowledge GraphsRepresentation LearningKARGEN: Knowledge-enhanced Automated Radiology Report Generation Using Large Language Models
Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology…
Common Sense ReasoningLogical Reasoning