MTT-Bench: Predicting Social Dominance in Mice via Multimodal Large Language Models
Understanding social dominance in animal behavior is critical for neuroscience and behavioral studies. In this work, we explore the capability of Multimodal Large Language Models(MLLMs) to analyze raw behavioral video of mice and predict their dominance hierarchy. We introduce MTT-Bench, a novel benchmark comprising annotated videos of pairwise mouse interactions for Mouse Tube Test analysis. Building on existing MLLM architectures, we fine-tune these models to perform zero-shot inference on unseen behavioral sequences, predicting social dominance without explicit labels during testing. Our framework demonstrates promising results, showing high agreement with tube test rankings. This work opens a new direction for applying foundation models to ethology and social behavior analysis, without the need to design domain-specific models.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Emergent Dominance Hierarchies in Reinforcement Learning Agents
Modern Reinforcement Learning (RL) algorithms are able to outperform humans in a wide variety of tasks. Multi-agent reinforcement learning (MARL) settings present additional challenges, and successful cooperation in mixe…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Multimodal Claim Extraction for Fact-Checking
Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinformation. Social media posts often combine short, informal text with …
Visual Question AnsweringImage CaptioningMiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps
Multimodal Chain of Thought (MCoT) is a popular prompting strategy for improving the performance of multimodal large language models (MLLMs) across a range of complex reasoning tasks. Despite its popularity, there is a n…
Image DescriptionInformativenessThe insertion of Neomycin cassette impairs maternal and social behaviors in Arc/Arg3.1 knock-out mice
The Neomycin resistance cassette (Neo+) is commonly inserted in the genome of mice to generate knock-out (KO) models. The effect of gene deletion on social behaviors in mice is controversial between studies using differe…
ARCCross-Skeleton Interaction Graph Aggregation Network for Representation Learning of Mouse Social Behaviour
Automated social behaviour analysis of mice has become an increasingly popular research area in behavioural neuroscience. Recently, pose information (i.e., locations of keypoints or skeleton) has been used to interpret s…
Representation LearningSelf-Supervised Learning