Video-based Generative Performance Benchmarking (Temporal Understanding) 벤치마크

Video-based Generative Performance Benchmarking (Temporal Understanding) on VideoInstruct

54개 결과 · ⬇ CSV · JSON

gpt-score

Rank	Model	gpt-score	Paper	Code	Year
1	PPLLaVA-7B	3.21	PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance	farewellthree/ppllava	2024
2	ST-LLM	2.93	ST-LLM: Large Language Models Are Effective Temporal Learners	TencentARC/ST-LLM	2024
3	VideoGPT+	2.83	VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding	mbzuai-oryx/videogpt-plus	2024
4	SlowFast-LLaVA-34B	2.77	SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models	apple/ml-slowfast-llava	2024
4	TS-LLaVA-34B	2.77	TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models	tingyu215/ts-llava	2024
6	PLLaVA-34B	2.67	PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning	magic-research/PLLaVA	2024
7	VideoChat2	2.66	MVBench: A Comprehensive Multi-modal Video Understanding Benchmark	opengvlab/ask-anything · magic-research/PLLaVA · bytedance/tarsier	2023
8	MiniGPT4-video-7B	2.65	MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens	Vision-CAIR/MiniGPT4-video · pwc-1/Paper-9	2024
8	VideoChat2_HD_mistral	2.65	MVBench: A Comprehensive Multi-modal Video Understanding Benchmark	opengvlab/ask-anything · magic-research/PLLaVA · bytedance/tarsier	2023
10	VTimeLLM	2.49	VTimeLLM: Empower LLM to Grasp Video Moments	huangb23/vtimellm	2023
11	Chat-UniVi	2.39	Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding	pku-yuangroup/chat-univi · skyworkai/moh · skyworkai/moe-plus-plus · +1	2023
12	BT-Adapter	2.34	BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning	farewellthree/BT-Adapter	2023
13	MovieChat	2.24	MovieChat: From Dense Token to Sparse Memory for Long Video Understanding	rese1f/MovieChat	2023
14	BT-Adapter (zero-shot)	2.13	BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning	farewellthree/BT-Adapter	2023
15	Video-ChatGPT	1.98	Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models	mbzuai-oryx/video-chatgpt · qiujihao19/artemis	2023
15	LLaMA Adapter	1.98	LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model	opengvlab/llama-adapter · zrrskywalker/llama-adapter · Mind23-2/MindCode-140	2023
17	Video Chat	1.94	VideoChat: Chat-Centric Video Understanding	opengvlab/ask-anything	2023
18	Video LLaMA	1.82	Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding	damo-nlp-sg/video-llama · damo-nlp-sg/videollama2 · damo-nlp-sg/videollama3 · +1	2023
19	PPLLaVA-7B	3.21	PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance	farewellthree/ppllava	2024
20	ST-LLM	2.93	ST-LLM: Large Language Models Are Effective Temporal Learners	TencentARC/ST-LLM	2024