Passage Retrieval 벤치마크
Passage Retrieval on EntityQuestions
Recall@20
- 2021-09-17 — BM25: Recall@20 0.72
- 2021-10-12 — TOME-2: Recall@20 0.838
| Rank | Model | Recall@20 | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | TOME-2 | 0.838 | Mention Memory: incorporating textual knowledge into Transformers through entity mention attention | google-research/language | 2021 |
| 2 | SPAR-PAQ | 0.740 | Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One? | facebookresearch/dpr-scale · facebookresearch/dpr-scale | 2021 |
| 3 | BM25 | 0.720 | Simple Entity-Centric Questions Challenge Dense Retrievers | princeton-nlp/entityquestions | 2021 |
| 4 | Zero-NeR | 0.671 | Can a Frozen Pretrained Language Model be used for Zero-shot Neural Retrieval on Entity-centric Questions? | 2023 | |
| 5 | Contriever | 0.647 | Can a Frozen Pretrained Language Model be used for Zero-shot Neural Retrieval on Entity-centric Questions? | 2023 | |
| 6 | DPR-multi | 0.567 | Simple Entity-Centric Questions Challenge Dense Retrievers | princeton-nlp/entityquestions | 2021 |
| 7 | DPR-NQ | 0.497 | Simple Entity-Centric Questions Challenge Dense Retrievers | princeton-nlp/entityquestions | 2021 |