paper-with-me

Papers

Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling

2026-06-26 · Qinfeng Zhu, Lei Fan arxiv

Panoramic images capture the complete visual sphere in a single frame, providing spatial context unattainable by conventional cameras. Yet this completeness comes at a geometric cost: the 2-sphere cannot be faithfully mapped to the plane, and every planar representation introduces distortions that violate the assumptions underlying standard vision architectures. This survey traces the evolution of panoramic scene analysis along a methodological trajectory, from projection-based adaptation, through distortion-aware engineering, to sphere-native modeling and geometry-aware tokenization for foundation models, and argues that this evolution reflects a progressive deepening of geometric commitment rather than a simple accumulation of techniques. We organize the literature along two orthogonal dimensions: architectural design (how operators interact with spherical geometry) and training paradigm (how knowledge is transferred across domains). Covering dense prediction (semantic segmentation, depth estimation, and room layout estimation), unified multi-task understanding, open-world perception, vision-language reasoning, and dynamic video analysis, we identify a central unresolved tension: among the methods surveyed, none simultaneously delivers strict spherical equivariance and full reuse of perspective-pretrained foundation-model weights, and we argue that this is a structural rather than incidental gap. We further expose five systematic gaps in current evaluation protocols, namely the absence of spherical-area-weighted metrics, seam-consistency testing, polar-robustness stratification, cross-projection generalization, and open-world protocol standardization, and propose a six-point research roadmap toward general-purpose panoramic intelligence. The corresponding repository is publicly available at: https://github.com/zhuqinfeng1999/Awesome-Panoramic-Scene-Analysis.

📄 PDF Abstract BibTeX arXiv:2606.27745

Code (0)

등록된 구현이 없습니다.

Tasks

Room Layout EstimationSemantic SegmentationDepth Estimation

Similar Papers 제목 키워드 기반

One Flight Over the Gap: A Survey from Perspective to Panoramic Vision

2025-09-04 · Xin Lin, Xian Ge, Dizhe Zhang, Zhaoliang Wan 외 arxiv

Driven by the demand for spatial intelligence and holistic scene perception, omnidirectional images (ODIs), which provide a complete 360\textdegree{} field of view, are receiving growing attention across diverse applicat…

Autonomous DrivingDomain Adaptation

Multi-source Domain Adaptation for Panoramic Semantic Segmentation

2024-08-29 · Jing Jiang, Sicheng Zhao, Jiankun Zhu, Wenbo Tang 외

Unsupervised domain adaptation methods for panoramic semantic segmentation utilize real pinhole images or low-cost synthetic panoramic images to transfer segmentation models to real panoramic images. However, these metho…

Domain AdaptationSegmentationSemantic SegmentationUnsupervised Domain Adaptation

Distortion-Aware Convolutional Filters for Dense Prediction in Panoramic Images

2018-09-01 · ECCV 2018 9 · Keisuke Tateno, Nassir Navab, Federico Tombari

There is a high demand of 3D data for 360° panoramic images and videos, pushed by the growing availability on the market of specialized hardware for both capturing (e.g., omnidirectional cameras) as well as visualizing …

Depth EstimationSemantic SegmentationStyle Transfer

PanoWan: Lifting Diffusion Video Generation Models to 360° with Latitude/Longitude-aware Mechanisms

2025-05-28 · Yifei Xia, Shuchen Weng, Siqi Yang, Jingqi Liu 외

Panoramic video generation enables immersive 360{\deg} content creation, valuable in applications that demand scene-consistent world exploration. However, existing panoramic video generation models struggle to leverage p…

DenoisingVideo Generation

Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation

2022-03-02 · CVPR 2022 1 · Jiaming Zhang, Kailun Yang, Chaoxiang Ma, Simon Reiß 외

Panoramic images with their 360-degree directional view encompass exhaustive information about the surrounding space, providing a rich foundation for scene understanding. To unfold this potential in the form of robust pa…

Domain AdaptationScene UnderstandingSemantic SegmentationUnsupervised Domain Adaptation