Image Captioning 벤치마크
Image Captioning on WHOOPS!
BLEU-4
- 2023-03-13 — BLIP2 FlanT5-XXL (Fine-tuned): BLEU-4 42.0
| Rank | Model | BLEU-4 | CIDEr | Extra Training Data | Paper | Code | Year |
|---|---|---|---|---|---|---|---|
| 1 | BLIP2 FlanT5-XXL (Fine-tuned) | 42 | 177 | ✓ | Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images | 2023 | |
| 2 | BLIP2 FlanT5-XL (Fine-tuned) | 41 | 174 | ✓ | Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images | 2023 | |
| 3 | BLIP2 FlanT5-XXL (Zero-Shot) | 31 | 120 | Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images | 2023 | ||
| 4 | CoCa ViT-L-14 MSCOCO | 25 | 102 | Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images | 2023 | ||
| 5 | BLIP Large | 13 | 65 | Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images | 2023 | ||
| 6 | OFA Large | 0 | 0 | Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images | 2023 |