Spatial Visibility and Temporal Dynamics: Revolutionizing Field of View Prediction in Adaptive Point Cloud Video Streaming

2024-09-26 · Chen Li, Tongyu Zong, Yueyu Hu, Yao Wang, Yong liu

Field-of-View (FoV) adaptive streaming significantly reduces bandwidth requirement of immersive point cloud video (PCV) by only transmitting visible points in a viewer's FoV. The traditional approaches often focus on trajectory-based 6 degree-of-freedom (6DoF) FoV predictions. The predicted FoV is then used to calculate point visibility. Such approaches do not explicitly consider video content's impact on viewer attention, and the conversion from FoV to point visibility is often error-prone and time-consuming. We reformulate the PCV FoV prediction problem from the cell visibility perspective, allowing for precise decision-making regarding the transmission of 3D data at the cell level based on the predicted visibility distribution. We develop a novel spatial visibility and object-aware graph model that leverages the historical 3D visibility data and incorporates spatial perception, neighboring cell correlation, and occlusion information to predict the cell visibility in the future. Our model significantly improves the long-term cell visibility prediction, reducing the prediction MSE loss by up to 50% compared to the state-of-the-art models while maintaining real-time performance (more than 30fps) for point cloud videos with over 1 million points.

📄 PDF Abstract BibTeX arXiv:2409.18236

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Prediction

Methods 이 논문이 사용한 방법론

Focus 설명 없음

SpaTeoGL: Spatiotemporal Graph Learning for Interpretable Seizure Onset Zone Analysis from Intracranial EEG

2026-02-12 · Elham Rostami, Aref Einizade, Taous-Meriem Laleg-Kirati arxiv

Accurate localization of the seizure onset zone (SOZ) from intracranial EEG (iEEG) is essential for epilepsy surgery but is challenged by complex spatiotemporal seizure dynamics. We propose SpaTeoGL, a spatiotemporal gra…

Graph Learning

Multifaceted Exploration of Spatial Openness in Rental Housing: A Big Data Analysis in Tokyo's 23 Wards

2025-12-20 · Takuya OKi, Yuan Liu arxiv

Understanding spatial openness is vital for improving residential quality and design; however, studies often treat its influencing factors separately. This study developed a quantitative framework to evaluate the spatial…

Semantic Segmentation

Graph Neural Alchemist: An innovative fully modular architecture for time series-to-graph classification

2024-10-12 · Paulo Coelho, Raul Araju, Luís Ramos, Samir Saliba 외

This paper introduces a novel Graph Neural Network (GNN) architecture for time series classification, based on visibility graph representations. Traditional time series classification methods often struggle with high com…

Graph Classification Graph Neural Network Time Series Time Series Analysis+1

Pair-wise Layer Attention with Spatial Masking for Video Prediction

2023-11-19 · Ping Li, Chenhan Zhang, Zheng Yang, Xianghua Xu 외

Video prediction yields future frames by employing the historical frames and has exhibited its great potential in many applications, e.g., meteorological prediction, and autonomous driving. Previous works often decode th…

Autonomous Driving Decoder Prediction Video Prediction

DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving

2026-05-22 · Hao Vo, Khoa Vo, Phu Loc Nguyen, Sieu Tran 외 arxiv

Spatiotemporal intelligence in autonomous driving (AD) requires an agent to integrate multi-view observations into a coherent scene representation, maintain object continuity across viewpoints and time, and reason about …

Autonomous Driving Question Answering