paper-with-me

Papers

RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering

2026-06-29 · Huangsheng Du, Haoran Zhu, Youcheng Cai, Jinyang Meng, Ligang Liu arxiv

We present RenderFormer++, a scalable and physically grounded feed-forward neural rendering framework for global illumination in mesh scenes. Existing Transformer-based neural rendering methods such as RenderFormer achieve promising cross-scene generalization, but suffer from limited physical consistency and poor scalability due to the quadratic attention complexity of triangle-level tokenization. To address these issues, we introduce Physics-Informed Transport Guidance (PITG), which embeds rendering-equation inductive biases into the attention mechanism and enforces transport consistency loss, enabling physically consistent light transport modeling. We further propose Hierarchical Object-Centric Tokenization (HOCT), which aggregates triangle-level features into compact object-level tokens via cross-attention with learnable queries, substantially reducing computational and memory costs while preserving geometric and radiometric information. Extensive experiments demonstrate that RenderFormer++ achieves scalable, stable, and generalizable feed-forward global illumination rendering across complex large-scale scenes with improved physical accuracy and efficiency over prior neural rendering methods.

📄 PDF Abstract BibTeX arXiv:2606.30380

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RenderFormer-V2: Neural Rendering with Heterogeneous Scene Primitives

2026-09-04 · Chong Zeng, Yue Dong, Pieter Peers, Lvmin Zhang 외 hf

We present 'RenderFormer-V2', a unified learned transformer-based neural rendering model, complementary to modern physics-based rendering systems, that can handle diverse light-transport effects such as caustics, volumet…

InvSplat: Inverse Feed-Forward Scene Splatting

2026-07-02 · Polina Karpikova, Wenjing Bian, Haofei Xu, Hendrik Lensch 외 arxiv

Inverse rendering aims to recover both 3D geometry and physically meaningful material properties from images, enabling applications such as relighting and novel view synthesis. Optimization-based methods achieve high fid…

Multi-View 3D ReconstructionNovel View SynthesisInverse Rendering

IDT: A Physically Grounded Transformer for Feed-Forward Multi-View Intrinsic Decomposition

2025-12-29 · Kang Du, Yirui Guan, Zeyu Wang arxiv

Intrinsic image decomposition is fundamental for visual understanding, as RGB images entangle material properties, illumination, and view-dependent effects. Recent diffusion-based methods have achieved strong results for…

RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illumination

2025-05-28 · Chong Zeng, Yue Dong, Pieter Peers, Hongzhi Wu 외

We present RenderFormer, a neural rendering pipeline that directly renders an image from a triangle-based representation of a scene with full global illumination effects and that does not require per-scene training or fi…

Neural Rendering

OmniUMI: Towards Physically Grounded Robot Learning via Human-Aligned Multimodal Interaction

2026-04-12 · Shaqi Luo, Yuanyuan Li, Youhao Hu, Chenhao Yu 외 arxiv

UMI-style interfaces enable scalable robot learning, but existing systems remain largely visuomotor, relying primarily on RGB observations and trajectory while providing only limited access to physical interaction signal…