paper-with-me

Papers

FLAT: Chinese NER Using Flat-Lattice Transformer

2020-04-24 · ACL 2020 6 · Xiaonan Li, Hang Yan, Xipeng Qiu, Xuanjing Huang

Recently, the character-word lattice structure has been proved to be effective for Chinese named entity recognition (NER) by incorporating the word information. However, since the lattice structure is complex and dynamic, most existing lattice-based models are hard to fully utilize the parallel computation of GPUs and usually have a low inference-speed. In this paper, we propose FLAT: Flat-LAttice Transformer for Chinese NER, which converts the lattice structure into a flat structure consisting of spans. Each span corresponds to a character or latent word and its position in the original lattice. With the power of Transformer and well-designed position encoding, FLAT can fully leverage the lattice information and has an excellent parallelization ability. Experiments on four datasets show FLAT outperforms other lexicon-based models in performance and efficiency.

📄 PDF Abstract BibTeX arXiv:2004.11795

Code (1)

LeeSureman/Flat-Lattice-Transformer 공식 구현 pytorch

Tasks

Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERPosition

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

NFLAT: Non-Flat-Lattice Transformer for Chinese Named Entity Recognition

2022-05-12 · Shuang Wu, Xiaoning Song, ZhenHua Feng, Xiao-Jun Wu

Recently, Flat-LAttice Transformer (FLAT) has achieved great success in Chinese Named Entity Recognition (NER). FLAT performs lexical enhancement by constructing flat lattices, which mitigates the difficulties posed by b…

Chinese Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

An End-to-end Chinese Text Normalization Model based on Rule-guided Flat-Lattice Transformer

2022-03-31 · Wenlin Dai, Changhe Song, Xiang Li, Zhiyong Wu 외

Text normalization, defined as a procedure transforming non standard words to spoken-form words, is crucial to the intelligibility of synthesized speech in text-to-speech system. Rule-based methods without considering co…

Text Normalizationtext-to-speechText to Speech

Lex-BERT: Enhancing BERT based NER with lexicons

2021-01-02 · Wei Zhu, Daniel Cheung

In this work, we represent Lex-BERT, which incorporates the lexicon information into Chinese BERT for named entity recognition (NER) tasks in a natural manner. Instead of using word embeddings and a newly designed transf…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2

Double-sided probing by map of Asplund's distances using Logarithmic Image Processing in the framework of Mathematical Morphology

2017-01-27 · Guillaume Noyel, Michel Jourlin

We establish the link between Mathematical Morphology and the map of Asplund's distances between a probe and a grey scale function, using the Logarithmic Image Processing scalar multiplication. We demonstrate that the ma…

Flat Multi-modal Interaction Transformer for Named Entity Recognition

2022-08-23 · COLING 2022 10 · Junyu Lu, Dixiang Zhang, Pingjian Zhang

Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of differe…

Boundary DetectionMulti-modal Named Entity Recognitionnamed-entity-recognitionNamed Entity Recognition+1