paper-with-me

홈 › Papers

PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images

2026-06-01 · Yuan Zhang, Jiahao Xia, Junzhang Huang, Meng Wang, Feng Chen, Guanyu Yang, Huazhu Fu arxiv

Data scarcity in multimodal pathology motivates unified generative models that synthesize modality-specific appearance while preserving anatomically coherent structure. Although modalities differ in appearance statistics, morphological structures such as cellular topology and tissue boundaries are largely preserved across acquisition protocols. However, existing methods often model these factors within a homogeneous token stream, implicitly coupling structure with appearance and weakening structural controllability under modality shifts. To address this, we propose pathology Autorgressive modeling (PathAR), a structure-first autoregressive synthesis framework that explicitly factorizes structure and appearance for modality-label-conditioned pathology generation.PathAR employs a dual vector quantization (Dual-VQ) tokenizer to decompose samples into mask-grounded structure and appearance tokens, and an interleaved autoregressive (IAR) transformer with asymmetric attention visibility to enforce structure-to-appearance dependence. PathAR stabilizes morphology under heterogeneous modality-specific appearances and enables spatially aligned image--mask pair generation. Extensive experiments show that PathAR improves structural consistency and modality fidelity over baselines, maintains sample diversity, supports downstream segmentation in data-scarce regimes, and demonstrates extensibility to finer-grained intra-modality organ-label variation.

📄 PDF Abstract BibTeX arXiv:2606.01543

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

OneFlow: Concurrent Mixed-Modal and Interleaved Generation with Edit Flows

2025-10-03 · John Nguyen, Marton Havasi, Tariq Berrada, Luke Zettlemoyer 외 arxiv

We present OneFlow, the first non-autoregressive multimodal model that enables variable-length and concurrent mixed-modal generation. Unlike autoregressive models that enforce rigid causal ordering between text and image…

Image Generation

MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generation

2025-08-26 · Ming Chen, Liyuan Cui, Wenyuan Zhang, Haoxian Zhang 외 arxiv

Recently, interactive digital human video generation has attracted widespread attention and achieved remarkable progress. However, building such a practical system that can interact with diverse input signals in real tim…

Video Generation

Robust Dancer: Long-term 3D Dance Synthesis Using Unpaired Data

2023-03-29 · Bin Feng, Tenglong Ao, Zequn Liu, Wei Ju 외

How to automatically synthesize natural-looking dance movements based on a piece of music is an incrementally popular yet challenging task. Most existing data-driven approaches require hard-to-get paired training data an…

Disentanglement

MedITok: A Unified Tokenizer for Medical Image Synthesis and Interpretation

2025-05-25 · Chenglong Ma, Yuanfeng Ji, Jin Ye, Zilong Li 외

Advanced autoregressive models have reshaped multimodal AI. However, their transformative potential in medical imaging remains largely untapped due to the absence of a unified visual tokenizer -- one capable of capturing…

Image GenerationImage Reconstruction

Beyond Patches: Global-aware Autoregressive Model for Multimodal Few-Shot Font Generation

2026-01-04 · Haonan Cai, Yuxuan Luo, Zhouhui Lian arxiv

Manual font design is an intricate process that transforms a stylistic visual concept into a coherent glyph set. This challenge persists in automated Few-shot Font Generation (FFG), where models often struggle to preserv…