paper-with-me

Papers

Fractal Autoregressive Depth Estimation with Continuous Token Diffusion

2026-03-16 · Jinchang Zhang, Xinrou Kang, Guoyu Lu arxiv

Monocular depth estimation can benefit from autoregressive (AR) generation, but direct AR modeling is hindered by the modality gap between RGB and depth, inefficient pixel-wise generation, and instability in continuous depth prediction. We propose a Fractal Visual Autoregressive Diffusion framework that reformulates depth estimation as a coarse-to-fine, next-scale autoregressive generation process. A VCFR module fuses multi-scale image features with current depth predictions to improve cross-modal conditioning, while a conditional denoising diffusion loss models depth distributions directly in continuous space and mitigates errors caused by discrete quantization. To improve computational efficiency, we organize the scale-wise generators into a fractal recursive architecture, reusing a base visual AR unit in a self-similar hierarchy. We further introduce an uncertainty-aware robust consensus aggregation scheme for multi-sample inference to improve fusion stability and provide a practical pixel-wise reliability estimate. Experiments on standard benchmarks demonstrate strong performance and validate the effectiveness of the proposed design.

📄 PDF Abstract BibTeX arXiv:2603.14702

Code (0)

등록된 구현이 없습니다.

Tasks

Monocular Depth EstimationComputational Efficiency

Similar Papers 제목 키워드 기반

Scalable Autoregressive Monocular Depth Estimation

2024-11-18 · CVPR 2025 1 · Jinhong Wang, Jian Liu, Dongqi Tang, Weiqiang Wang 외

This paper shows that the autoregressive model is an effective and scalable monocular depth estimator. Our idea is simple: We tackle the monocular depth estimation (MDE) task with an autoregressive prediction paradigm, b…

Depth EstimationMonocular Depth EstimationZero-shot Generalization

DepthART: Monocular Depth Estimation as Autoregressive Refinement Task

2024-09-23 · Bulat Gabdullin, Nina Konovalova, Nikolay Patakin, Dmitry Senushkin 외

Despite recent success in discriminative approaches in monocular depth estimation its quality remains limited by training datasets. Generative approaches mitigate this issue by leveraging strong priors derived from train…

Depth EstimationImage GenerationMonocular Depth Estimation

Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis

2025-07-02 · Peng Zheng, Junke Wang, Yi Chang, Yizhou Yu 외

Recent advances in large language models (LLMs) have spurred interests in encoding images as discrete tokens and leveraging autoregressive (AR) frameworks for visual generation. However, the quantization process in AR-ba…

Density EstimationImage GenerationQuantization

Fractal Generative Models

2025-02-24 · Tianhong Li, Qinyi Sun, Lijie Fan, Kaiming He

Modularization is a cornerstone of computer science, abstracting complex functions into atomic building blocks. In this paper, we introduce a new level of modularization by abstracting generative models into atomic gener…

Image Generation

Depth Adaptive Efficient Visual Autoregressive Modeling

2026-04-19 · Chunliang Li, Tianze Cao, Sanyuan Zhao arxiv

Visual Autoregressive (VAR) modeling inefficiently applies a fixed computational depth to each position when generating high-resolution images. While existing methods accelerate inference by pruning tokens using frequenc…