paper-with-me

홈 › Papers

BLIP3o-NEXT: Next Frontier of Native Image Generation

2025-10-17 · Jiuhai Chen, Le Xue, Zhiyang Xu, Xichen Pan, Shusheng Yang, Can Qin, An Yan, Honglu Zhou, Zeyuan Chen, Lifu Huang, Tianyi Zhou, Junnan Li, Silvio Savarese, Caiming Xiong, Ran Xu arxiv

We present BLIP3o-NEXT, a fully open-source foundation model in the BLIP3 series that advances the next frontier of native image generation. BLIP3o-NEXT unifies text-to-image generation and image editing within a single architecture, demonstrating strong image generation and image editing capabilities. In developing the state-of-the-art native image generation model, we identify four key insights: (1) Most architectural choices yield comparable performance; an architecture can be deemed effective provided it scales efficiently and supports fast inference; (2) The successful application of reinforcement learning can further push the frontier of native image generation; (3) Image editing still remains a challenging task, yet instruction following and the consistency between generated and reference images can be significantly enhanced through post-training and data engine; (4) Data quality and scale continue to be decisive factors that determine the upper bound of model performance. Building upon these insights, BLIP3o-NEXT leverages an Autoregressive + Diffusion architecture in which an autoregressive model first generates discrete image tokens conditioned on multimodal inputs, whose hidden states are then used as conditioning signals for a diffusion model to generate high-fidelity images. This architecture integrates the reasoning strength and instruction following of autoregressive models with the fine-detail rendering ability of diffusion models, achieving a new level of coherence and realism. Extensive evaluations of various text-to-image and image-editing benchmarks show that BLIP3o-NEXT achieves superior performance over existing models.

📄 PDF Abstract BibTeX arXiv:2510.15857

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image GenerationReinforcement LearningInstruction FollowingImage Editing

Similar Papers 제목 키워드 기반

VAR-CLIP: Text-to-Image Generator with Visual Auto-Regressive Modeling

2024-08-02 · Qian Zhang, Xiangzi Dai, Ninghua Yang, Xiang An 외

VAR is a new generation paradigm that employs 'next-scale prediction' as opposed to 'next-token prediction'. This innovative transformation enables auto-regressive (AR) transformers to rapidly learn visual distributions …

Image Generation

Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs

2026-05-09 · Guijin Son, Seungone Kim, Catherine Arnett, Hyunwoo Ko 외 arxiv

Following the recent achievement of gold-medal performance on the IMO by frontier LLMs, the community is searching for the next meaningful and challenging target for measuring LLM reasoning. Whereas olympiad-style proble…

Self-Chained Image-Language Model for Video Localization and Question Answering

2023-05-11 · NeurIPS 2023 11 · Shoubin Yu, Jaemin Cho, Prateek Yadav, Mohit Bansal

Recent studies have shown promising results on utilizing large pre-trained image-language models for video question answering. While these image-language models can efficiently bootstrap the representation learning of vi…

Language ModelingLanguage ModellingQuestion AnsweringRepresentation Learning+3

Frontier: Simulating the Next Generation of LLM Inference Systems

2025-08-05 · Yicheng Feng, Xin Tan, Kin Hang Sew, Yimin Jiang 외 arxiv

Large Language Model (LLM) inference is growing increasingly complex with the rise of Mixture-of-Experts (MoE) models and disaggregated architectures that decouple components like prefill/decode (PD) or attention/FFN (AF…

Towards Zero-Shot Camera Trap Image Categorization

2024-10-16 · Jiří Vyskočil, Lukas Picek

This paper describes the search for an alternative approach to the automatic categorization of camera trap images. First, we benchmark state-of-the-art classifiers using a single model for all images. Next, we evaluate m…

Image Categorization