Integrating Deep Learning with Logic Fusion for Information Extraction
Information extraction (IE) aims to produce structured information from an input text, e.g., Named Entity Recognition and Relation Extraction. Various attempts have been proposed for IE via feature engineering or deep learning. However, most of them fail to associate the complex relationships inherent in the task itself, which has proven to be especially crucial. For example, the relation between 2 entities is highly dependent on their entity types. These dependencies can be regarded as complex constraints that can be efficiently expressed as logical rules. To combine such logic reasoning capabilities with learning capabilities of deep neural networks, we propose to integrate logical knowledge in the form of first-order logic into a deep learning system, which can be trained jointly in an end-to-end manner. The integrated framework is able to enhance neural outputs with knowledge regularization via logic rules, and at the same time update the weights of logic rules to comply with the characteristics of the training data. We demonstrate the effectiveness and generalization of the proposed model on multiple IE tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningFeature Engineeringnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)RelationRelation ExtractionSimilar Papers 제목 키워드 기반
GeoTop: Advancing Image Classification with Geometric-Topological Analysis
In this study, we explore the application of Topological Data Analysis (TDA) and Lipschitz-Killing Curvatures (LKCs) as powerful tools for feature extraction and classification in the context of biomedical multiomics pro…
Classificationimage-classificationImage ClassificationTopological Data AnalysisLearning from Limited and Incomplete Data: A Multimodal Framework for Predicting Pathological Response in NSCLC
Major pathological response (pR) following neoadjuvant therapy is a clinically meaningful endpoint in non-small cell lung cancer, strongly associated with improved survival. However, accurate preoperative prediction of p…
Multimodal Deep LearningPSA-MF: Personality-Sentiment Aligned Multi-Level Fusion for Multimodal Sentiment Analysis
Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from diffe…
Multimodal Sentiment AnalysisMilmer: a Framework for Multiple Instance Learning based Multimodal Emotion Recognition
Emotions play a crucial role in human behavior and decision-making, making emotion recognition a key area of interest in human-computer interaction (HCI). This study addresses the challenges of emotion recognition by int…
EEGElectroencephalogram (EEG)Emotion RecognitionMultimodal Emotion Recognition+1Document-level Biomedical Relation Extraction Based on Multi-Dimensional Fusion Information and Multi-Granularity Logical Reasoning
Document-level biomedical relation extraction (Bio-DocuRE) is an important branch of biomedical text mining that aims to automatically extract all relation facts from the biomedical text. Since there are a considerable n…
Logical ReasoningRelationRelation Extraction