paper-with-me

Coreference Resolution 벤치마크

Coreference Resolution on CoNLL 2012

18개 결과 · ⬇ CSV · JSON

Avg F1

67.2 71.3 75.4 79.5 83.6 2017-07 2026-11 e2e-coref + ELMo — 70.4 (2017-07-21) e2e-coref (ensemble) — 68.8 (2017-07-21) e2e-coref (single) — 67.2 (2017-07-21) c2f-coref + ELMo — 73.0 (2018-04-15) EE + BERT-large — 76.61 (2019-07-01) reinforced model + ELMO — 73.8 (2019-07-01) c2f-coref + BERT-large — 76.9 (2019-08-24) dali-full-anaphora — 76.4 (2019-11-21) CorefQA + SpanBERT-large — 83.1 (2020-07-01) CorefQA + SpanBERT-base — 79.9 (2020-07-01) SpanBERT + Cluster Merging — 80.2 (2020-09-25) U-MEM* + SpanBERT-large — 79.6 (2020-10-06) s2e + Longformer-Large — 80.3 (2021-01-02) c2f + SpanBERT-Large — 80.2 (2021-01-02) wl-coref + RoBERTa — 81.0 (2021-09-09) ASP+T0-3B — 82.3 (2022-10-26) seq2seq — 83.3 (2022-11-22) Maverick_mes — 83.6 (2024-07-31) e2e-coref + ELMo — 70.4 (2017-07-21) c2f-coref + ELMo — 73.0 (2018-04-15) EE + BERT-large — 76.61 (2019-07-01) c2f-coref + BERT-large — 76.9 (2019-08-24) CorefQA + SpanBERT-large — 83.1 (2020-07-01) seq2seq — 83.3 (2022-11-22) Maverick_mes — 83.6 (2024-07-31)
RankModel Avg F1 Extra Training Data PaperCodeYear
1 Maverick_mes 83.6 Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends sapienzanlp/maverick-coref 2024
2 seq2seq 83.3 Coreference Resolution through a seq2seq Transition-Based System google-research/google-research 2022
3 CorefQA + SpanBERT-large 83.1 ✓ CorefQA: Coreference Resolution as Query-based Span Prediction ShannonAI/CorefQA 2020
4 ASP+T0-3B 82.3 Autoregressive Structured Prediction with Language Models lyutyuh/asp 2022
5 wl-coref + RoBERTa 81.0 Word-Level Coreference Resolution vdobrovolskii/wl-coref 2021
6 s2e + Longformer-Large 80.3 Coreference Resolution without Span Representations yuvalkirstain/s2e-coref 2021
7 SpanBERT + Cluster Merging 80.2 Revealing the Myth of Higher-Order Inference in Coreference Resolution lxucs/coref-hoi 2020
7 c2f + SpanBERT-Large 80.2 Coreference Resolution without Span Representations yuvalkirstain/s2e-coref 2021
9 CorefQA + SpanBERT-base 79.9 ✓ CorefQA: Coreference Resolution as Query-based Span Prediction ShannonAI/CorefQA 2020
10 U-MEM* + SpanBERT-large 79.6 Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks shtoshni/fast-coref · shtoshni92/fast-coref · shtoshni92/long-doc-coref 2020
11 c2f-coref + BERT-large 76.9 ✓ BERT for Coreference Resolution: Baselines and Analysis mandarjoshi90/coref · wooseok-AI/Korean_e2e_CR_BERT 2019
12 EE + BERT-large 76.61 ✓ Coreference Resolution with Entity Equalization kkjawz/coref-ee 2019
13 dali-full-anaphora 76.4 A Cluster Ranking Model for Full Anaphora Resolution juntaoy/dali-full-anaphora 2019
14 reinforced model + ELMO 73.8 End-to-end Deep Reinforcement Learning Based Coreference Resolution 2019
15 c2f-coref + ELMo 73.0 Higher-order Coreference Resolution with Coarse-to-fine Inference kentonl/e2e-coref · shayneobrien/coreference-resolution · bkntr/coref-ee · +2 2018
16 e2e-coref + ELMo 70.4 End-to-end Neural Coreference Resolution kentonl/e2e-coref · shayneobrien/coreference-resolution · ppriyank/Bert-Coref-Resolution-Lee- · +1 2017
17 e2e-coref (ensemble) 68.8 End-to-end Neural Coreference Resolution kentonl/e2e-coref · shayneobrien/coreference-resolution · ppriyank/Bert-Coref-Resolution-Lee- · +1 2017
18 e2e-coref (single) 67.2 End-to-end Neural Coreference Resolution kentonl/e2e-coref · shayneobrien/coreference-resolution · ppriyank/Bert-Coref-Resolution-Lee- · +1 2017
1–18 / 18 페이지당 10 20 50 100