Audio-visual Question Answering
1개 벤치마크 · 논문 41편 · 이 태스크의 논문 보기 →
Benchmarks
MUSIC-AVQA
Most implemented
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning
PAVE: Patching and Adapting Video Large Language Models
Question-Aware Gaussian Experts for Audio-Visual Question Answering
Boosting Audio Visual Question Answering via Key Semantic-Aware Cues
Papers
LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception
Hour-scale audio-visual question answering is constrained by a context dilemma: dense whole-recording encoding rapidly exhausts context limits, whereas uniform temporal compression severely dilutes fine-grained acoustic …
Audio-visual Question AnsweringReasoning for Social Audio-Visual Question Answering: Where Do We Stand?
Training Multimodal Large Language Models for audio-visual social understanding is a crucial step toward embodied social intelligence. Chain-of-thought (CoT) reasoning has become the dominant approach, with HumanOmniV2 a…
Audio-visual Question AnsweringQ-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering
Audio-Visual Question Answering (AVQA) extends classical VQA by requiring joint reasoning over video and synchronized audio. However, many AVQA systems rely on deeply stacked layers of self- and cross attention across te…
Audio-visual Question AnsweringOmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chains
Current automated pipelines for audio-visual Question Answering (QA) generally adopt a ``video-caption-QA'' paradigm. However, these methods typically segment videos into short clips and generate separate descriptions fo…
Audio-visual Question AnsweringVisual ReasoningSeparate First, Fuse Later: Mitigating Cross-Modal Interference in Audio-Visual LLMs Reasoning with Modality-Specific Chain-of-Thought
Audio and vision provide complementary evidence for audio-visual question answering, yet current audio-visual large language models may suffer from cross-modal interference: information from one modality misguides the in…
Audio-visual Question AnsweringReinforcement LearningVisual ReasoningRetrieving to Recover: Towards Incomplete Audio-Visual Question Answering via Semantic-consistent Purification
Recent Audio-Visual Question Answering (AVQA) methods have advanced significantly. However, most AVQA methods lack effective mechanisms for handling missing modalities, suffering from severe performance degradation in re…
Audio-visual Question AnsweringCross-Modal Retrieval