paper-with-me

홈 › Papers

An Intellectual Property Entity Recognition Method Based on Transformer and Technological Word Information

2022-03-21 · Yuhui Wang, Junping Du, Yingxia Shao

Patent texts contain a large amount of entity information. Through named entity recognition, intellectual property entity information containing key information can be extracted from it, helping researchers to understand the patent content faster. Therefore, it is difficult for existing named entity extraction methods to make full use of the semantic information at the word level brought about by professional vocabulary changes. This paper proposes a method for extracting intellectual property entities based on Transformer and technical word information , and provides accurate word vector representation in combination with the BERT language method. In the process of word vector generation, the technical word information extracted by IDCNN is added to improve the understanding of intellectual property entities Representation ability. Finally, the Transformer encoder that introduces relative position encoding is used to learn the deep semantic information of the text from the sequence of word vectors, and realize entity label prediction. Experimental results on public datasets and annotated patent datasets show that the method improves the accuracy of entity recognition.

📄 PDF Abstract BibTeX arXiv:2203.10717

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

Research on Intellectual Property Resource Profile and Evolution Law

2022-04-13 · Yuhui Wang, Yingxia Shao, Ang Li

In the era of big data, intellectual property-oriented scientific and technological resources show the trend of large data scale, high information density and low value density, which brings severe challenges to the effe…

Adaptive Dual Channel Convolution Hypergraph Representation Learning for Technological Intellectual Property

2022-10-12 · Yuxin Liu, Yawen Li, Yingxia Shao, Zeli Guan

In the age of big data, the demand for hidden information mining in technological intellectual property is increasing in discrete countries. Definitely, a considerable number of graph learning algorithms for technologica…

Graph LearningRepresentation Learning

Model Barrier: A Compact Un-Transferable Isolation Domain for Model Intellectual Property Protection

2023-03-20 · CVPR 2023 1 · Lianyu Wang, Meng Wang, Daoqiang Zhang, Huazhu Fu

As scientific and technological advancements result from human intellectual labor and computational costs, protecting model intellectual property (IP) has become increasingly important to encourage model creators and own…

model

Design and Analysis of Intellectual Property Protection Strategies Based on Differential Equations

2024-11-01 · Hambur Wang

This paper constructs a novel intellectual property (IP) protection strategy using differential equation theory, aiming to analyze and optimize the effectiveness of IP protection. By developing a mathematical model, it e…

How to Prove Your Model Belongs to You: A Blind-Watermark based Framework to Protect Intellectual Property of DNN

2019-03-05 · Zheng Li, Chengyu Hu, Yang Zhang, Shanqing Guo

Deep learning techniques have made tremendous progress in a variety of challenging tasks, such as image recognition and machine translation, during the past decade. Training deep neural networks is computationally expens…

Machine Translation