paper-with-me

홈 › Papers

PANORAMA: The Rise of Omnidirectional Vision in the Embodied AI Era

2025-09-16 · Xu Zheng, Chenfei Liao, Ziqiao Weng, Kaiyu Lei, Zihao Dongfang, Haocong He, Yuanhuiyi Lyu, Lutao Jiang, Lu Qi, Li Chen, Danda Pani Paudel, Kailun Yang, Linfeng Zhang, Luc Van Gool, Xuming Hu arxiv

Omnidirectional vision, using 360-degree vision to understand the environment, has become increasingly critical across domains like robotics, industrial inspection, and environmental monitoring. Compared to traditional pinhole vision, omnidirectional vision provides holistic environmental awareness, significantly enhancing the completeness of scene perception and the reliability of decision-making. However, foundational research in this area has historically lagged behind traditional pinhole vision. This talk presents an emerging trend in the embodied AI era: the rapid development of omnidirectional vision, driven by growing industrial demand and academic interest. We highlight recent breakthroughs in omnidirectional generation, omnidirectional perception, omnidirectional understanding, and related datasets. Drawing on insights from both academia and industry, we propose an ideal panoramic system architecture in the embodied AI era, PANORAMA, which consists of four key subsystems. Moreover, we offer in-depth opinions related to emerging trends and cross-community impacts at the intersection of panoramic vision and embodied AI, along with the future roadmap and open challenges. This overview synthesizes state-of-the-art advancements and outlines challenges and opportunities for future research in building robust, general-purpose omnidirectional AI systems in the embodied AI era.

📄 PDF Abstract BibTeX arXiv:2509.12989

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Omnidirectional Spatial Modeling from Correlated Panoramas

2025-09-02 · Xinshen Zhang, Tongxi Fu, Xu Zheng arxiv

Omnidirectional scene understanding is vital for various downstream applications, such as embodied AI, autonomous driving, and immersive environments, yet remains challenging due to geometric distortion and complex spati…

Visual Question AnsweringScene UnderstandingAutonomous Driving

OmniSCV: An Omnidirectional Synthetic Image Generator for Computer Vision

2024-01-30 · Bruno Berenguel-Baeta, Jesus Bermudez-Cameo, Jose J. Guerrero

Omnidirectional and 360{\deg} images are becoming widespread in industry and in consumer society, causing omnidirectional computer vision to gain attention. Their wide field of view allows the gathering of a great amount…

3D Reconstruction

Distortion-aware Monocular Depth Estimation for Omnidirectional Images

2020-10-18 · Hong-Xiang Chen, Kunhong Li, Zhiheng Fu, Mengyi Liu 외

A main challenge for tasks on panorama lies in the distortion of objects among images. In this work, we propose a Distortion-Aware Monocular Omnidirectional (DAMO) dense depth estimation network to address this challenge…

Depth EstimationMonocular Depth Estimation

LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation

2024-08-23 · Shuai Yang, Jing Tan, Mengchen Zhang, Tong Wu 외

3D immersive scene generation is a challenging yet critical task in computer vision and graphics. A desired virtual 3D scene should 1) exhibit omnidirectional view consistency, and 2) allow for free exploration in comple…

Scene Generation

GLPanoDepth: Global-to-Local Panoramic Depth Estimation

2022-02-06 · Jiayang Bai, Shuichang Lai, Haoyu Qin, Jie Guo 외

In this paper, we propose a learning-based method for predicting dense depth values of a scene from a monocular omnidirectional image. An omnidirectional image has a full field-of-view, providing much more complete descr…

Depth Estimation