paper-with-me

홈 › Papers

Innovator-VL: A Multimodal Large Language Model for Scientific Discovery

2026-01-27 · Zichen Wen, Boxue Yang, Shuang Chen, Yaojie Zhang, Yuhang Han, Junlong Ke, Cong Wang, Yicheng Fu, Jiawang Zhao, Jiangchao Yao, Xi Fang, Zhen Wang, Henxing Cai, Lin Yao, Zhifeng Gao, Yanhui Hong, Nang Yuan, Yixuan Li, Guojiang Zhao, Haoyi Tao, Nan Wang, Han Lyu, Guolin Ke, Ning Liao, Xiaoxing Wang, Kai Chen, Zhiyu Li, Feiyu Xiong, Sihan Hu, Kun Chen, Yanfeng Wang, Weinan E, Linfeng Zhang, Linfeng Zhang arxiv

We present Innovator-VL, a scientific multimodal large language model designed to advance understanding and reasoning across diverse scientific domains while maintaining excellent performance on general vision tasks. Contrary to the trend of relying on massive domain-specific pretraining and opaque pipelines, our work demonstrates that principled training design and transparent methodology can yield strong scientific intelligence with substantially reduced data requirements. (i) First, we provide a fully transparent, end-to-end reproducible training pipeline, covering data collection, cleaning, preprocessing, supervised fine-tuning, reinforcement learning, and evaluation, along with detailed optimization recipes. This facilitates systematic extension by the community. (ii) Second, Innovator-VL exhibits remarkable data efficiency, achieving competitive performance on various scientific tasks using fewer than five million curated samples without large-scale pretraining. These results highlight that effective reasoning can be achieved through principled data selection rather than indiscriminate scaling. (iii) Third, Innovator-VL demonstrates strong generalization, achieving competitive performance on general vision, multimodal reasoning, and scientific benchmarks. This indicates that scientific alignment can be integrated into a unified model without compromising general-purpose capabilities. Our practices suggest that efficient, reproducible, and high-performing scientific multimodal models can be built even without large-scale data, providing a practical foundation for future research.

📄 PDF Abstract BibTeX arXiv:2601.19325

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningMultimodal Reasoning

Similar Papers 제목 키워드 기반

Innovator: Scientific Continued Pretraining with Fine-grained MoE Upcycling

2025-07-24 · Ning Liao, Xiaoxing Wang, Zehao Lin, Weiyang Guo 외 arxiv

A large language model (LLM) with knowledge in both scientific and general tasks is the foundation of science general intelligence. However, directly continued pretraining an LLM using science data usually leads to catas…

DeepInnovator: Triggering the Innovative Capabilities of LLMs

2026-02-21 · Tianyu Fan, Fengji Zhang, Yuxiang Zheng, Bei Chen 외 arxiv

The application of Large Language Models (LLMs) in accelerating scientific discovery has garnered increasing attention, with a key focus on constructing research agents endowed with innovative capability, i.e., the abili…

Prompt Engineering

InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research

2025-10-31 · Yunze Wu, Dayuan Fu, Weiye Si, Zhen Huang 외 arxiv

AI agents could accelerate scientific discovery by automating hypothesis formation, experiment design, coding, execution, and analysis, yet existing benchmarks probe narrow skills in simplified settings. To address this …

Decision Making

Let the Abyss Stare Back Adaptive Falsification for Autonomous Scientific Discovery

2026-03-30 · Peiran Li, Fangzhou Lin, Shuo Xing, Jiashuo Sun 외 arxiv

Autonomous scientific discovery is entering a more dangerous regime: once the evaluator is frozen, a sufficiently strong search process can learn to win the exam without learning the mechanism the task was meant to revea…

The language and social behavior of innovators

2022-09-20 · A. Fronzetti Colladon, L. Toschi, E. Ughetto, F. Greco

Innovators are creative people who can conjure the ground-breaking ideas that represent the main engine of innovative organizations. Past research has extensively investigated who innovators are and how they behave in wo…

Decision Making