paper-with-me

Papers

ERNIE-Image Technical Report

2026-05-25 · Jiaxiang Liu, Zhida Feng, Pengyu Zou, Zhenyu Qian, Tianrui Zhu, Jun Xia, Yuehu Dong, Yanzheng Lin, Honglin Xiong, Anqi Chen, Yunpeng Ding, Jinghui Duan, Lin Gao, Chao Han, Tiechao He, Jiakang Hu, Ranjun Hua, Xueming Jiang, Qingli Kong, Yuting Lei, Tianyu Li, Yunlin Liu, Changling Liu, Yaxin Liu, Yi Liu, Xuguang Liu, Xiaolong Ma, Yan Pan, Yiran Ren, Nan Sheng, Yu Sun, Siyang Sun, Yixiang Tu, Yang Wan, Huanai Wang, Siqi Wang, Yang Wu, Youzhi Yang, Xiaowen Yang, Jianwen Yang, Yehua Yang, Quanwen Zhang, Xinmin Zhang, Haoxin Zhang, Xiang Zhang, Jun Zhang, Qian Zhang, Qiao Zhao, Qi Zhou arxiv

We introduce ERNIE-Image, an open-source text-to-image generation model built upon an 8B single-stream DiT architecture. ERNIE-Image aims to bridge the gap between current open-source models and leading closed-source systems through more effective mining of large-scale pre-training data and improved supervision quality throughout training. During pre-training, we adopt a bottom-up data construction pipeline that combines fine-grained image categorization, rich caption annotation, aesthetic assessment, and hierarchical sampling. This strategy reduces data noise while preserving long-tail concepts and detailed real-world knowledge, providing a stronger foundation for complex generation tasks. In the post-training stage, we use a top-down data construction pipeline for high-demand scenarios, diversify prompt annotations to better match real user inputs, and apply a stabilized DPO strategy to align the model with human aesthetic preferences. We further train ERNIE-Image-Turbo for efficient 8-NFE generation and propose MT-DMD to mitigate capability drift during distillation. To make the model easier to use in practical scenarios, we equip it with a lightweight Prompt Enhancer that expands concise user intents into structured visual descriptions. In addition, we develop ERNIE-Image-Aes, an industrial-grade aesthetic model, together with ERNIE-Image-Aes-1K, a human-annotated benchmark for realistic aesthetic evaluation. Extensive qualitative and quantitative experiments show that ERNIE-Image achieves leading performance among open-source models and approaches top-tier commercial models in instruction following, text rendering, and aesthetic quality. We release the trained models and aesthetic resources to facilitate further academic research and technical progress in the AIGC community.

📄 PDF Abstract BibTeX arXiv:2605.25347

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image GenerationInstruction Following

Similar Papers 제목 키워드 기반

ERNIE 5.0 Technical Report

2026-02-04 · Haifeng Wang, Hua Wu, Tian Wu, Yu Sun 외 arxiv

In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio. All modalities are trained from scratc…

Reinforcement Learning

Fine-tuning ERNIE for chest abnormal imaging signs extraction

2020-10-25 · Zhaoning Li, Jiangtao Ren

Chest imaging reports describe the results of chest radiography procedures. Automatic extraction of abnormal imaging signs from chest imaging reports has a pivotal role in clinical research and a wide range of downstream…

ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graph

2020-06-30 · Fei Yu, Jiji Tang, Weichong Yin, Yu Sun 외

We propose a knowledge-enhanced approach, ERNIE-ViL, which incorporates structured knowledge obtained from scene graphs to learn joint representations of vision-language. ERNIE-ViL tries to build the detailed semantic co…

AttributePredictionReferring Expression ComprehensionSentence+1

ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation

2022-11-09 · Bin Shan, Yaqian Han, Weichong Yin, Shuohuan Wang 외

Recent cross-lingual cross-modal works attempt to extend Vision-Language Pre-training (VLP) models to non-English inputs and achieve impressive performance. However, these models focus only on understanding tasks utilizi…

Contrastive LearningDecoderLanguage ModelingLanguage Modelling+6

ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training

2022-09-30 · Bin Shan, Weichong Yin, Yu Sun, Hao Tian 외

Recent Vision-Language Pre-trained (VLP) models based on dual encoder have attracted extensive attention from academia and industry due to their superior performance on various cross-modal tasks and high computational ef…

Computational EfficiencyContrastive LearningCross-Modal RetrievalImage Retrieval+5