paper-with-me

홈 › Papers

Synchronous Dual Network with Cross-Type Attention for Joint Entity and Relation Extraction

2021-11-01 · EMNLP 2021 11 · Hui Wu, Xiaodong Shi

Joint entity and relation extraction is challenging due to the complex interaction of interaction between named entity recognition and relation extraction. Although most existing works tend to jointly train these two tasks through a shared network, they fail to fully utilize the interdependence between entity types and relation types. In this paper, we design a novel synchronous dual network (SDN) with cross-type attention via separately and interactively considering the entity types and relation types. On the one hand, SDN adopts two isomorphic bi-directional type-attention LSTM to encode the entity type enhanced representations and the relation type enhanced representations, respectively. On the other hand, SDN explicitly models the interdependence between entity types and relation types via cross-type attention mechanism. In addition, we also propose a new multi-task learning strategy via modeling the interaction of two types of information. Experiments on NYT and WebNLG datasets verify the effectiveness of the proposed model, achieving state-of-the-art performance.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Joint Entity and Relation ExtractionMulti-Task Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)RelationRelation ExtractionVocal Bursts Type Prediction

Similar Papers 제목 키워드 기반

Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation

2026-04-26 · Chunyu Li, Jiaye Li, Ruiqiao Mei, Haoyuan Xia 외 arxiv

Real-time text-driven joint audio-video avatar generation requires jointly synthesizing portrait video and speech with high fidelity and precise synchronization, yet existing audio-visual diffusion models remain too slow…

Combining Frame-Synchronous and Label-Synchronous Systems for Speech Recognition

2021-07-01 · Qiujia Li, Chao Zhang, Philip C. Woodland

Commonly used automatic speech recognition (ASR) systems can be classified into frame-synchronous and label-synchronous categories, based on whether the speech is decoded on a per-frame or per-label basis. Frame-synchron…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Decoderspeech-recognition+1

SDPT: Synchronous Dual Prompt Tuning for Fusion-based Visual-Language Pre-trained Models

2024-07-16 · Yang Zhou, Yongjian Wu, Jiya Saiyin, Bingzheng Wei 외

Prompt tuning methods have achieved remarkable success in parameter-efficient fine-tuning on large pre-trained models. However, their application to dual-modal fusion-based visual-language pre-trained models (VLPMs), suc…

parameter-efficient fine-tuning

Temporal Attention Augmented Transformer Hawkes Process

2021-12-29 · Lu-ning Zhang, Jian-wei Liu, Zhi-yan Song, Xin Zuo

In recent years, mining the knowledge from asynchronous sequences by Hawkes process is a subject worthy of continued attention, and Hawkes processes based on the neural network have gradually become the most hotly resear…

speech-recognitionSpeech Recognition

TiVaT: A Transformer with a Single Unified Mechanism for Capturing Asynchronous Dependencies in Multivariate Time Series Forecasting

2024-10-02 · Junwoo Ha, Hyukjae Kwon, Sungsoo Kim, Kisu Lee 외

Multivariate time series (MTS) forecasting is vital across various domains but remains challenging due to the need to simultaneously model temporal and inter-variate dependencies. Existing channel-dependent models, where…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting