paper-with-me

Papers

UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision

2026-01-06 · Ruiyan Han, Zhen Fang, XinYu Sun, Yuchen Ma, Ziheng Wang, Yu Zeng, Zehui Chen, Lin Chen, Wenxuan Huang, Wei-Jie Xu, Yi Cao, Feng Zhao arxiv

While Unified Multimodal Models (UMMs) have achieved remarkable success in cross-modal comprehension, a significant gap persists in their ability to leverage such internal knowledge for high-quality generation. We formalize this discrepancy as Conduction Aphasia, a phenomenon where models accurately interpret multimodal inputs but struggle to translate that understanding into faithful and controllable synthesis. To address this, we propose UniCorn, a simple yet elegant self-improvement framework that eliminates the need for external data or teacher supervision. By partitioning a single UMM into three collaborative roles: Proposer, Solver, and Judge, UniCorn generates high-quality interactions via self-play and employs cognitive pattern reconstruction to distill latent understanding into explicit generative signals. To validate the restoration of multimodal coherence, we introduce UniCycle, a cycle-consistency benchmark based on a Text to Image to Text reconstruction loop. Extensive experiments demonstrate that UniCorn achieves comprehensive and substantial improvements over the base model across six general image generation benchmarks. Notably, it achieves SOTA performance on TIIF(73.8), DPG(86.8), CompBench(88.5), and UniCycle while further delivering substantial gains of +5.0 on WISE and +6.5 on OneIG. These results highlight that our method significantly enhances T2I generation while maintaining robust comprehension, demonstrating the scalability of fully self-supervised refinement for unified multimodal intelligence.

📄 PDF Abstract BibTeX arXiv:2601.03193

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

Towards Grand Unification of Object Tracking

2022-07-14 · Bin Yan, Yi Jiang, Peize Sun, Dong Wang 외

We present a unified method, termed Unicorn, that can simultaneously solve four tracking problems (SOT, MOT, VOS, MOTS) with a single network using the same model parameters. Due to the fragmented definitions of the obje…

Multi-Object TrackingMulti-Object Tracking and SegmentationMultiple Object TrackingObject+3

Unicorn: A Unified Multi-tasking Model for Supporting Matching Tasks in Data Integration

2023-05-01 · SIGMOD/PODS 2023 5 · Jianhong Tu, Ju Fan, Nan Tang, Peng Wang 외

Data matching - which decides whether two data elements (e.g., string, tuple, column, or knowledge graph entity) are the "same" (a.k.a. a match) - is a key concept in data integration, such as entity matching and schema …

Data IntegrationEntity ResolutionMixture-of-ExpertsZero-Shot Learning

Unicorn: Unified Neural Image Compression with One Number Reconstruction

2024-12-11 · Qi Zheng, Haozhi Wang, Zihao Liu, Jiaming Liu 외

Prevalent lossy image compression schemes can be divided into: 1) explicit image compression (EIC), including traditional standards and neural end-to-end algorithms; 2) implicit image compression (IIC) based on implicit …

DecoderImage Compression

Unicorn: A Universal and Collaborative Reinforcement Learning Approach Towards Generalizable Network-Wide Traffic Signal Control

2025-03-14 · Yifeng Zhang, Yilin Liu, Ping Gong, Peizhuo Li 외

Adaptive traffic signal control (ATSC) is crucial in reducing congestion, maximizing throughput, and improving mobility in rapidly growing urban areas. Recent advancements in parameter-sharing multi-agent reinforcement l…

Contrastive LearningMulti-agent Reinforcement LearningTraffic Signal ControlVariational Inference

Unicorn: Text-Only Data Synthesis for Vision Language Model Training

2025-03-28 · Xiaomin Yu, Pengxiang Ding, Wenjie Zhang, Siteng Huang 외

Training vision-language models (VLMs) typically requires large-scale, high-quality image-text pairs, but collecting or synthesizing such data is costly. In contrast, text data is abundant and inexpensive, prompting the …

Language ModelingLanguage Modelling