Word Sense Disambiguation on Words in Context

37개 결과 · ⬇ CSV · JSON

Accuracy

Rank	Model	Accuracy	Paper	Code	Year
1	COSINE + Transductive Learning	85.3	Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach	yueyu1030/COSINE	2020
2	PaLM 540B (finetuned)	78.8	PaLM: Scaling Language Modeling with Pathways	lucidrains/CoCa-pytorch · lucidrains/PaLM-pytorch · google/paxml · +4	2022
3	ST-MoE-32B 269B (fine-tuned)	77.7	ST-MoE: Designing Stable and Transferable Sparse Expert Models	tensorflow/mesh · xuefuzhao/openmoe · yikangshen/megablocks	2022
4	DeBERTa-Ensemble	77.5	DeBERTa: Decoding-enhanced BERT with Disentangled Attention	huggingface/transformers · microsoft/DeBERTa · osu-nlp-group/mind2web · +11	2020
5	Vega v2 6B (fine-tuned)	77.4	Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE		2022
6	UL2 20B (fine-tuned)	77.3	UL2: Unifying Language Learning Paradigms	google-research/google-research · opennlg/openba-v2	2022
7	Turing NLR v5 XXL 5.4B (fine-tuned)	77.1	Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE		2022
8	T5-XXL 11B	76.9	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	huggingface/transformers · PaddlePaddle/PaddleNLP · google-research/text-to-text-transfer-transformer · +54	2019
9	DeBERTa-1.5B	76.4	DeBERTa: Decoding-enhanced BERT with Disentangled Attention	huggingface/transformers · microsoft/DeBERTa · osu-nlp-group/mind2web · +11	2020
10	ST-MoE-L 4.1B (fine-tuned)	74	ST-MoE: Designing Stable and Transferable Sparse Expert Models	tensorflow/mesh · xuefuzhao/openmoe · yikangshen/megablocks	2022
11	SenseBERT-large 340M	72.1	SenseBERT: Driving Some Sense into BERT		2019
12	SenseBERT-base 110M	70.3	SenseBERT: Driving Some Sense into BERT		2019
13	PaLM 2-L (one-shot)	66.8	PaLM 2 Technical Report	eternityyw/tram-benchmark	2023
14	BERT-large 340M	65.5	WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations		2018
15	FLAN-T5-Large 783M	64.7	LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions	mbzuai-nlp/lamini-lm	2023
16	LaMini-F-T5 783M	63.8	LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions	mbzuai-nlp/lamini-lm	2023
17	Context2vec	59.3	WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations		2018
18	DeConf	58.7	WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations		2018
19	SW2V	58.1	WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations		2018
20	ElMo	57.7	WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations		2018