paper-with-me

Papers

Active Zero: Self-Evolving Vision-Language Models through Active Environment Exploration

2026-02-11 · Jinghan He, Junfeng Fang, Feng Xiong, Zijun Yao, Fei Shen, Haiyun Guo, Jinqiao Wang, Tat-Seng Chua arxiv

Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in strong dependence on initial datasets and inefficient learning. Without the ability to actively seek visual data tailored to their evolving capabilities, agents waste computational effort on samples that are either trivial or beyond their current skill level. To address these limitations, we propose Active-Zero, a framework that shifts from passive interaction to active exploration of visual environments. Active-Zero employs three co-evolving agents: a Searcher that retrieves images from open-world repositories based on the model's capability frontier, a Questioner that synthesizes calibrated reasoning tasks, and a Solver refined through accuracy rewards. This closed loop enables self-scaffolding auto-curricula where the model autonomously constructs its learning trajectory. On Qwen2.5-VL-7B-Instruct across 12 benchmarks, Active-Zero achieves 53.97 average accuracy on reasoning tasks (5.7% improvement) and 59.77 on general understanding (3.9% improvement), consistently outperforming existing self-play baselines. These results highlight active exploration as a key ingredient for scalable and adaptive self-evolving vision-language systems.

📄 PDF Abstract BibTeX arXiv:2602.11241

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Data

2026-03-10 · Zongxia Li, Hongyang Du, Chengsong Huang, Xiyang Wu 외 arxiv

Self-evolving has emerged as a key paradigm for improving foundational models such as Large Language Models (LLMs) and Vision Language Models (VLMs) with minimal human intervention. While recent approaches have demonstra…

Multimodal Reasoning

Vision-Zero: Scalable VLM Self-Improvement via Strategic Gamified Self-Play

2025-09-29 · Qinsi Wang, Bo Liu, Tianyi Zhou, Jing Shi 외 arxiv

Although reinforcement learning (RL) has emerged as a promising approach for improving vision-language models (VLMs) and multimodal large language models (MLLMs), current methods rely heavily on manually curated datasets…

Chart Question AnsweringReinforcement Learning

Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning

2025-11-25 · Jiaqi Liu, Kaiwen Xiong, Peng Xia, Yiyang Zhou 외 arxiv

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding ap…

Reinforcement LearningMultimodal ReasoningVisual Reasoning

Self-Evolving Visual Questioner

2026-06-11 · Yijun Liang, Hengguang Zhou, Ming Li, Lichen Li 외 arxiv

Vision-language models (VLMs) are typically trained as passive answerers, while their ability to actively ask diverse, non-trivial, visual-centric and grounded questions remains underexplored. Existing visual questioners…

Question Generation

Active Learning for Vision-Language Models

2024-10-29 · Bardia Safaei, Vishal M. Patel

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap betwe…

Active Learningimage-classificationImage Classificationzero-shot-classification+1