VCGBench-Diverse
1개 벤치마크 · 논문 5편 · 이 태스크의 논문 보기 →
Benchmarks
VideoInstruct
Most implemented
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models
VTimeLLM: Empower LLM to Grasp Video Moments
Papers
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
Building on the advances of language models, Large Multimodal Models (LMMs) have contributed significant improvements in video understanding. While the current video LMMs utilize advanced Large Language Models (LLMs), th…
Dense Video CaptioningMVBenchQuestion AnsweringVCGBench-Diverse+10VTimeLLM: Empower LLM to Grasp Video Moments
Large language models (LLMs) have shown remarkable text understanding capabilities, which have been extended as Video LLMs to handle video data for comprehending visual details. However, existing Video LLMs can only prov…
Dense Video CaptioningTemporal Relation ExtractionVCGBench-DiverseVideo-based Generative Performance Benchmarking+8MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
With the rapid development of Multi-modal Large Language Models (MLLMs), a number of diagnostic benchmarks have recently emerged to evaluate the comprehension capabilities of these models. However, most benchmarks predom…
3D Question Answering (3D-QA)DiagnosticFairnessMultiple-choice+12Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
Large language models have demonstrated impressive universal capabilities across a wide range of open-ended tasks and have extended their utility to encompass multimodal conversations. However, existing methods encounter…
Image-based Generative Performance BenchmarkingLanguage ModelingLanguage ModellingScience Question Answering+11Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models
Conversation agents fueled by Large Language Models (LLMs) are providing a new way to interact with visual data. While there have been initial attempts for image-based conversation models, this work addresses the under-e…
Question AnsweringVCGBench-DiverseVideo-based Generative Performance BenchmarkingVideo-based Generative Performance Benchmarking (Consistency)+7