image-sentence alignment on VALSE spatial relations
pairwise accuracy
- 2021-12-14 — GPT1: pairwise accuracy 77.2
| Rank | Model | pairwise accuracy | Accuracy (%) | Paper | Code | Year |
|---|---|---|---|---|---|---|
| 11 | CLIP | 64.3 | – | VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | heidelberg-nlp/valse | 2021 |
| 12 | LXMERT | 60.2 | 50.8 | VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | heidelberg-nlp/valse | 2021 |
| 13 | ViLBERT | 57.2 | 49.9 | VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | heidelberg-nlp/valse | 2021 |
| 14 | VisualBERT | 39.7 | 49.3 | VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena | heidelberg-nlp/valse | 2021 |