AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)
1개 벤치마크 · 논문 5편 · 이 태스크의 논문 보기 →
Benchmarks
MUSIC-AVQA v2.0
Most implemented
Question-Aware Gaussian Experts for Audio-Visual Question Answering
Meerkat: Audio-Visual Large Language Model for Grounding in Space and Time
Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering
Vision Transformers are Parameter-Efficient Audio-Visual Learners
Learning to Answer Questions in Dynamic Audio-Visual Scenarios
Papers
Question-Aware Gaussian Experts for Audio-Visual Question Answering
Audio-Visual Question Answering (AVQA) requires not only question-based multimodal reasoning but also precise temporal grounding to capture subtle dynamics for accurate prediction. However, existing methods mainly use qu…
Audio-visual Question AnsweringAudio-Visual Question Answering (AVQA)AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)Mixture-of-Experts+3Meerkat: Audio-Visual Large Language Model for Grounding in Space and Time
Leveraging Large Language Models' remarkable proficiency in text-based tasks, recent works on Multi-modal LLMs (MLLMs) extend them to other modalities like vision and audio. However, the progress in these directions has …
AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)Fact CheckingLanguage ModelingLanguage Modelling+2Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering
In recent years, there has been a growing emphasis on the intersection of audio, vision, and text modalities, driving forward the advancements in multimodal research. However, strong bias that exists in any modality can …
AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)Question AnsweringVision Transformers are Parameter-Efficient Audio-Visual Learners
Vision transformers (ViTs) have achieved impressive results on various computer vision tasks in the last several years. In this work, we study the capability of frozen ViTs, pretrained only on visual data, to generalize …
Audio-visual Question AnsweringAUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)Learning to Answer Questions in Dynamic Audio-Visual Scenarios
In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos. The problem requires comprehensive …
audio-visual learningAudio-visual Question AnsweringAudio-Visual Question Answering (AVQA)AUDIO-VISUAL QUESTION ANSWERING (MUSIC-AVQA-v2.0)+4