Named Entity Recognition (NER) 벤치마크
Named Entity Recognition (NER) on BC4CHEMD
F1
- 2019-04-15 — Att-BiLSTM-CRF: F1 91.14
- 2019-06-04 — BERN: F1 91.2
- 2020-11-12 — BLSTM-CNN-Char (SparkNLP): F1 93.72
- 2022-07-19 — BertForTokenClassification (Spark NLP): F1 94.39
| Rank | Model | F1 | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | BertForTokenClassification (Spark NLP) | 94.39 | Accurate clinical and biomedical Named entity recognition at scale | JohnSnowLabs/spark-nlp-workshop | 2022 |
| 2 | BLSTM-CNN-Char (SparkNLP) | 93.72 | Biomedical Named Entity Recognition at Scale | JohnSnowLabs/spark-nlp-workshop | 2020 |
| 3 | BERN2 | 92.8 | BERN2: an advanced neural biomedical named entity recognition and normalization tool | dmis-lab/bern2 | 2022 |
| 4 | aimped | 92.45 | |||
| 5 | BERN | 91.2 | A Neural Named Entity Recognition and Multi-Type Normalization Tool for Biomedical Text Mining | dmis-lab/bern | 2019 |
| 6 | Att-BiLSTM-CRF | 91.14 | An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition | lingluodlut/Att-ChemdNER | 2019 |
| 7 | UniNER-7B | 89.21 | UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition | universal-ner/universal-ner · emma1066/retrieval-augmented-it-openner | 2023 |