An Intellectual Property Entity Recognition Method Based on Transformer and Technological Word Information
Patent texts contain a large amount of entity information. Through named entity recognition, intellectual property entity information containing key information can be extracted from it, helping researchers to understand the patent content faster. Therefore, it is difficult for existing named entity extraction methods to make full use of the semantic information at the word level brought about by professional vocabulary changes. This paper proposes a method for extracting intellectual property entities based on Transformer and technical word information , and provides accurate word vector representation in combination with the BERT language method. In the process of word vector generation, the technical word information extracted by IDCNN is added to improve the understanding of intellectual property entities Representation ability. Finally, the Transformer encoder that introduces relative position encoding is used to learn the deep semantic information of the text from the sequence of word vectors, and realize entity label prediction. Experimental results on public datasets and annotated patent datasets show that the method improves the accuracy of entity recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Research on Intellectual Property Resource Profile and Evolution Law
In the era of big data, intellectual property-oriented scientific and technological resources show the trend of large data scale, high information density and low value density, which brings severe challenges to the effe…
Adaptive Dual Channel Convolution Hypergraph Representation Learning for Technological Intellectual Property
In the age of big data, the demand for hidden information mining in technological intellectual property is increasing in discrete countries. Definitely, a considerable number of graph learning algorithms for technologica…
Graph LearningRepresentation LearningModel Barrier: A Compact Un-Transferable Isolation Domain for Model Intellectual Property Protection
As scientific and technological advancements result from human intellectual labor and computational costs, protecting model intellectual property (IP) has become increasingly important to encourage model creators and own…
modelDesign and Analysis of Intellectual Property Protection Strategies Based on Differential Equations
This paper constructs a novel intellectual property (IP) protection strategy using differential equation theory, aiming to analyze and optimize the effectiveness of IP protection. By developing a mathematical model, it e…
How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNN
Deep learning techniques have made tremendous progress in a variety of challenging tasks, such as image recognition and machine translation, during the past decade. Training deep neural networks is computationally expens…
Machine Translation