SEBERTNets: Sequence Enhanced BERT Networks for Event Entity Extraction Tasks Oriented to the Finance Field

2024-01-21 · Congqing He, Xiangyu Zhu, Yuquan Le, Yuzhong Liu, Jianhong Yin

Event extraction lies at the cores of investment analysis and asset management in the financial field, and thus has received much attention. The 2019 China conference on knowledge graph and semantic computing (CCKS) challenge sets up a evaluation competition for event entity extraction task oriented to the finance field. In this task, we mainly focus on how to extract the event entity accurately, and recall all the corresponding event entity effectively. In this paper, we propose a novel model, Sequence Enhanced BERT Networks (SEBERTNets for short), which can inherit the advantages of the BERT,and while capturing sequence semantic information. In addition, motivated by recommendation system, we propose Hybrid Sequence Enhanced BERT Networks (HSEBERTNets for short), which uses a multi-channel recall method to recall all the corresponding event entity. The experimental results show that, the F1 score of SEBERTNets is 0.905 in the first stage, and the F1 score of HSEBERTNets is 0.934 in the first stage, which demonstarate the effectiveness of our methods.

📄 PDF Abstract BibTeX arXiv:2401.11408

Code (1)

hecongqing/CCKS2019_EventEntityExtraction_Rank5 공식 구현 tf

Tasks

Asset ManagementEvent Extraction Management

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Residual Connection 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Harnessing Generative LLMs for Enhanced Financial Event Entity Extraction Performance

2025-04-20 · Soo-joon Choi, Ji-jun Park

Financial event entity extraction is a crucial task for analyzing market dynamics and building financial knowledge graphs, yet it presents significant challenges due to the specialized language and complex structures in …

Knowledge Graphs parameter-efficient fine-tuning Structured Output Generation

Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter

2021-05-15 · ACL 2021 5 · Wei Liu, Xiyan Fu, Yue Zhang, Wenming Xiao

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a sha…

named-entity-recognition Named Entity Recognition Named Entity Recognition (NER)Part-Of-Speech Tagging

Entity Enhanced BERT Pre-training for Chinese NER

2020-11-01 · EMNLP 2020 11 · Chen Jia, Yuefeng Shi, Qinrong Yang, Yue Zhang

Character-level BERT pre-trained in Chinese suffers a limitation of lacking lexicon information, which shows effectiveness for Chinese NER. To integrate the lexicon into pre-trained LMs for Chinese NER, we investigate a …

NER

E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT

2019-11-09 · Findings of the Association for Computational Linguistics 2020 · Nina Poerner, Ulli Waltinger, Hinrich Schütze

We present a novel way of injecting factual knowledge about entities into the pretrained BERT model (Devlin et al., 2019): We align Wikipedia2Vec entity vectors (Yamada et al., 2016) with BERT's native wordpiece vector s…

Entity Embeddings Entity Linking Language Modelling Question Answering+1

Knowledge Enhanced Contextual Word Representations

2019-09-09 · IJCNLP 2019 11 · Matthew E. Peters, Mark Neumann, Robert L. Logan IV, Roy Schwartz 외

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a g…

Entity Linking Entity Typing Language Modeling Language Modelling+3