paper-with-me

홈 › Papers

Modeling Multi-Granularity Hierarchical Features for Relation Extraction

2022-04-09 · NAACL 2022 7 · Xinnian Liang, Shuangzhi Wu, Mu Li, Zhoujun Li

Relation extraction is a key task in Natural Language Processing (NLP), which aims to extract relations between entity pairs from given texts. Recently, relation extraction (RE) has achieved remarkable progress with the development of deep neural networks. Most existing research focuses on constructing explicit structured features using external knowledge such as knowledge graph and dependency tree. In this paper, we propose a novel method to extract multi-granularity features based solely on the original input sentences. We show that effective structured features can be attained even without external knowledge. Three kinds of features based on the input sentences are fully exploited, which are in entity mention level, segment level, and sentence level. All the three are jointly and hierarchically modeled. We evaluate our method on three public benchmarks: SemEval 2010 Task 8, Tacred, and Tacred Revisited. To verify the effectiveness, we apply our method to different encoders such as LSTM and BERT. Experimental results show that our method significantly outperforms existing state-of-the-art models that even use external knowledge. Extensive analyses demonstrate that the performance of our model is contributed by the capture of multi-granularity features and the model of their hierarchical structure. Code and data are available at \url{https://github.com/xnliang98/sms}.

📄 PDF Abstract BibTeX arXiv:2204.04437

Code (1)

xnliang98/sms 공식 구현 pytorch

Tasks

RelationRelation ExtractionSentence

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Multi-granularity Interactive Attention Framework for Residual Hierarchical Pronunciation Assessment

2026-01-05 · Hong Han, Hao-Chen Pei, Zhao-Zheng Nie, Xin Luo 외 arxiv

Automatic pronunciation assessment plays a crucial role in computer-assisted pronunciation training systems. Due to the ability to perform multiple pronunciation tasks simultaneously, multi-aspect multi-granularity pronu…

Modeling Multi-Granularity Hierarchical Features for Relation Extraction

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Relation extraction is a key task in Natural Language Processing (NLP), which aims to extract relations between entity pairs from given texts. Recently, relation extraction (RE) has achieved remarkable progress with the …

RelationRelation ExtractionSentence

Multiple Interest and Fine Granularity Network for User Modeling

2021-12-05 · Jiaxuan Xie, Jianxiong Wei, Qingsong Hua, Yu Zhang

User modeling plays a fundamental role in industrial recommender systems, either in the matching stage and the ranking stage, in terms of both the customer experience and business revenue. How to extract users' multiple …

Recommendation Systems

Research on feature fusion and multimodal patent text based on graph attention network

2025-05-26 · Zhenzhen Song, Ziwei Liu, Hongji Li

Aiming at the problems of cross-modal feature fusion, low efficiency of long text modeling and lack of hierarchical semantic coherence in patent text semantic mining, this study proposes HGM-Net, a deep learning framewor…

Computational EfficiencyGraph AttentionPatent classificationSentence

MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding

2022-11-27 · Zilong Wang, Jiuxiang Gu, Chris Tensmeyer, Nikolaos Barmpalios 외

Document images are a ubiquitous source of data where the text is organized in a complex hierarchical structure ranging from fine granularity (e.g., words), medium granularity (e.g., regions such as paragraphs or figures…