paper-with-me

Papers

Effective Use of Graph Convolution Network and Contextual Sub-Tree forCommodity News Event Extraction

2021-09-27 · Meisin Lee, Lay-Ki Soon, Eu-Gene Siew

Event extraction in commodity news is a less researched area as compared to generic event extraction. However, accurate event extraction from commodity news is useful in abroad range of applications such as under-standing event chains and learning event-event relations, which can then be used for commodity price prediction. The events found in commodity news exhibit characteristics different from generic events, hence posing a unique challenge in event extraction using existing methods. This paper proposes an effective use of Graph Convolutional Networks(GCN) with a pruned dependency parse tree, termed contextual sub-tree, for better event ex-traction in commodity news. The event ex-traction model is trained using feature embed-dings from ComBERT, a BERT-based masked language model that was produced through domain-adaptive pre-training on a commodity news corpus. Experimental results show the efficiency of the proposed solution, which out-performs existing methods with F1 scores as high as 0.90. Furthermore, our pre-trained language model outperforms GloVe by 23%, and BERT and RoBERTa by 7% in terms of argument roles classification. For the goal of re-producibility, the code and trained models are made publicly available1.

📄 PDF Abstract BibTeX arXiv:2109.12781

Code (1)

meisin/commodity-news-event-extraction 공식 구현 pytorch

Tasks

Event ExtractionLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Graph Neural Networks for Contextual ASR with the Tree-Constrained Pointer Generator

2023-05-30 · Guangzhi Sun, Chao Zhang, Phil Woodland

The incorporation of biasing words obtained through contextual knowledge is of paramount importance in automatic speech recognition (ASR) applications. This paper proposes an innovative method for achieving end-to-end co…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Graph Neural Networkspeech-recognition+1

Dependency-driven Relation Extraction with Attentive Graph Convolutional Networks

2021-08-01 · ACL 2021 5 · Yuanhe Tian, Guimin Chen, Yan Song, Xiang Wan

Syntactic information, especially dependency trees, has been widely used by existing studies to improve relation extraction with better semantic guidance for analyzing the context information associated with the given en…

RelationRelation ClassificationRelation Extraction

Effective Use of Graph Convolution Network and Contextual Sub-Tree for Commodity News Event Extraction

2021-11-01 · EMNLP (ECONLP) 2021 11 · Meisin Lee, Lay-Ki Soon, Eu-Gene Siew

Event extraction in commodity news is a less researched area as compared to generic event extraction. However, accurate event extraction from commodity news is useful in abroad range of applications such as under-standin…

Event ExtractionLanguage ModelingLanguage Modelling

Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks

2019-09-08 · IJCNLP 2019 11 · Chen Zhang, Qiuchi Li, Dawei Song

Due to their inherent capability in semantic alignment of aspects and their context words, attention mechanism and Convolutional Neural Networks (CNNs) are widely applied for aspect-based sentiment classification. Howeve…

BenchmarkingClassificationGeneral ClassificationSentence+2

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

2024-09-15 · Xin Wang, Xinyi Bai

Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to ca…

PositionRelationRelation ExtractionRelation Prediction+1