paper-with-me

Papers

RenderFlow: Single-Step Neural Rendering via Flow Matching

2026-01-11 · Shenghao Zhang, Runtao Liu, Christopher Schroers, Yang Zhang arxiv

Conventional physically based rendering (PBR) pipelines generate photorealistic images through computationally intensive light transport simulations. Although recent deep learning approaches leverage diffusion model priors with geometry buffers (G-buffers) to produce visually compelling results without explicit scene geometry or light simulation, they remain constrained by two major limitations. First, the iterative nature of the diffusion process introduces substantial latency. Second, the inherent stochasticity of these generative models compromises physical accuracy and temporal consistency. In response to these challenges, we propose a novel, end-to-end, deterministic, single-step neural rendering framework, RenderFlow, built upon a flow matching paradigm. To further strengthen both rendering quality and generalization, we propose an efficient and effective module for sparse keyframe guidance. Our method significantly accelerates the rendering process and, by optionally incorporating sparsely rendered keyframes as guidance, enhances both the physical plausibility and overall visual quality of the output. The resulting pipeline achieves near real-time performance with photorealistic rendering quality, effectively bridging the gap between the efficiency of modern generative models and the precision of traditional physically based rendering. Furthermore, we demonstrate the versatility of our framework by introducing a lightweight, adapter-based module that efficiently repurposes the pretrained forward model for the inverse rendering task of intrinsic decomposition.

📄 PDF Abstract BibTeX arXiv:2601.06928

Code (0)

등록된 구현이 없습니다.

Tasks

Inverse Rendering

Similar Papers 제목 키워드 기반

SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillation

2026-04-07 · Wuyang Luan, Junhui Li, Weiguang Zhao, Wenjian Zhang 외 arxiv

Vision-Language-Action (VLA) models based on flow matching -- such as pi0, pi0.5, and SmolVLA -- achieve state-of-the-art generalist robotic manipulation, yet their iterative denoising, typically 10 ODE steps, introduces…

FlowIID: Single-Step Intrinsic Image Decomposition via Latent Flow Matching

2026-01-18 · Mithlesh Singla, Seema Kumari, Shanmuganathan Raman arxiv

Intrinsic Image Decomposition (IID) separates an image into albedo and shading components. It is a core step in many real-world applications, such as relighting and material editing. Existing IID models achieve good resu…

RFMSR: Residual Flow Matching for Image Super-Resolution

2026-07-14 · Shuwei Huang, Tianyao Luo, Jicheng Liu, Daizong Liu 외 arxiv

Image super-resolution (ISR) has witnessed remarkable progress with diffusion models and flow matching. The dominant text-to-image (T2I) based approaches leverage large-scale foundation models as generative priors, achie…

Image Super-Resolution

Flow-GRPO: Training Flow Matching Models via Online RL

2025-05-08 · Jie Liu, Gongye Liu, Jiajun Liang, Yangguang Li 외

We propose Flow-GRPO, the first method integrating online reinforcement learning (RL) into flow matching models. Our approach uses two key strategies: (1) an ODE-to-SDE conversion that transforms a deterministic Ordinary…

DenoisingDiversityReinforcement Learning (RL)Text Generation+1

Shortcut Flow Matching for Speech Enhancement: Step-Invariant flows via single stage training

2025-09-25 · Naisong Zhou, Saisamarth Rajesh Phaye, Milos Cernak, Tijana Stojkovic 외 arxiv

Diffusion-based generative models have achieved state-of-the-art performance for perceptual quality in speech enhancement (SE). However, their iterative nature requires numerous Neural Function Evaluations (NFEs), posing…

Speech Enhancement