paper-with-me

Papers

Domain Knowledge Empowered Structured Neural Net for End-to-End Event Temporal Relation Extraction

2020-09-15 · EMNLP 2020 11 · Rujun Han, Yichao Zhou, Nanyun Peng

Extracting event temporal relations is a critical task for information extraction and plays an important role in natural language understanding. Prior systems leverage deep learning and pre-trained language models to improve the performance of the task. However, these systems often suffer from two short-comings: 1) when performing maximum a posteriori (MAP) inference based on neural models, previous systems only used structured knowledge that are assumed to be absolutely correct, i.e., hard constraints; 2) biased predictions on dominant temporal relations when training with a limited amount of data. To address these issues, we propose a framework that enhances deep neural network with distributional constraints constructed by probabilistic domain knowledge. We solve the constrained inference problem via Lagrangian Relaxation and apply it on end-to-end event temporal relation extraction tasks. Experimental results show our framework is able to improve the baseline neural network models with strong statistical significance on two widely used datasets in news and clinical domains.

📄 PDF Abstract BibTeX arXiv:2009.07373

Code (1)

rujunhan/EMNLP-2020 공식 구현 pytorch

Tasks

Natural Language UnderstandingRelationRelation ExtractionTemporal Relation Extraction

Similar Papers 제목 키워드 기반

Deep Structured Neural Network for Event Temporal Relation Extraction

2019-09-22 · CONLL 2019 11 · Rujun Han, I-Hung Hsu, Mu Yang, Aram Galstyan 외

We propose a novel deep structured learning framework for event temporal relation extraction. The model consists of 1) a recurrent neural network (RNN) to learn scoring functions for pair-wise relations, and 2) a structu…

RelationRelation ExtractionTemporal Relation Extraction

Neural Datalog Through Time: Informed Temporal Modeling via Logical Specification

2020-06-30 · ICML 2020 1 · Hongyuan Mei, Guanghui Qin, Minjie Xu, Jason Eisner

Learning how to predict future events from patterns of past events is difficult when the set of possible event types is large. Training an unrestricted neural model might overfit to spurious patterns. To exploit domain-s…

AttacKG+:Boosting Attack Knowledge Graph Construction with Large Language Models

2024-05-08 · Yongheng Zhang, Tingwen Du, Yunshan Ma, Xiang Wang 외

Attack knowledge graph construction seeks to convert textual cyber threat intelligence (CTI) reports into structured representations, portraying the evolutionary traces of cyber attacks. Even though previous research has…

graph constructionIn-Context LearningKnowledge Graphs

MIRAI: Evaluating LLM Agents for Event Forecasting

2024-07-01 · Chenchen Ye, Ziniu Hu, Yihe Deng, Zijie Huang 외

Recent advancements in Large Language Models (LLMs) have empowered LLM agents to autonomously collect world information, over which to conduct reasoning to solve complex problems. Given this capability, increasing intere…

ArticlesBenchmarking

Meta-Transfer Learning Empowered Temporal Graph Networks for Cross-City Real Estate Appraisal

2024-10-11 · Weijia Zhang, Jindong Han, Hao liu, Wei Fan 외

Real estate appraisal is important for a variety of endeavors such as real estate deals, investment analysis, and real property taxation. Recently, deep learning has shown great promise for real estate appraisal by harne…

Meta-LearningMulti-Task LearningTransfer Learning