paper-with-me

Papers

Viewport Prediction, Bitrate Selection, and Beamforming Design for THz-Enabled 360° Video Streaming

2024-01-23 · Mehdi Setayesh, Vincent W. S. Wong

360{\deg} videos require significant bandwidth to provide an immersive viewing experience. Wireless systems using terahertz (THz) frequency band can meet this high data rate demand. However, self-blockage is a challenge in such systems. To ensure reliable transmission, this paper explores THz-enabled 360{\deg} video streaming through multiple multi-antenna access points (APs). Guaranteeing users' quality of experience (QoE) requires accurate viewport prediction to determine which video tiles to send, followed by asynchronous bitrate selection for those tiles and beamforming design at the APs. To address users' privacy and data heterogeneity, we propose a content-based viewport prediction framework, wherein users' head movement prediction models are trained using a personalized federated learning (PFL) algorithm. To address asynchronous decision-making for tile bitrates and dynamic THz link connections, we formulate the optimization of bitrate selection and beamforming as a macro-action decentralized partially observable Markov decision process (MacDec-POMDP) problem. To efficiently tackle this problem for multiple users, we develop two deep reinforcement learning (DRL) algorithms based on multi-agent actor-critic methods and propose a hierarchical learning framework to train the actor and critic networks. Experimental results show that our proposed approach provides a higher QoE when compared with three benchmark algorithms.

📄 PDF Abstract BibTeX arXiv:2401.13114

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement LearningFederated LearningPersonalized Federated Learning

Similar Papers 제목 키워드 기반

Training-Free Adaptive 360-degree Video Streaming via Semantic Potential Fields

2026-03-22 · Aizierjiang Aiersilan, Zhangfei Yang arxiv

Adaptive 360° video streaming for teleoperation faces two coupled challenges: viewport prediction under uncertain gaze patterns and bitrate adaptation over fluctuating wireless channels. While Deep Reinforcement Learning…

Reinforcement Learning

GSStream: 3D Gaussian Splatting based Volumetric Scene Streaming System

2026-03-10 · Zhiye Tang, Qiudan Zhang, Lei Zhang, Junhui Hou 외 arxiv

Recently, the 3D Gaussian splatting (3DGS) technique for real-time radiance field rendering has revolutionized the field of volumetric scene representation, providing users with an immersive experience. But in return, it…

Reinforcement Learning

Tile Classification Based Viewport Prediction with Multi-modal Fusion Transformer

2023-09-26 · Zhihao Zhang, YiWei Chen, Weizhan Zhang, Caixia Yan 외

Viewport prediction is a crucial aspect of tile-based 360 video streaming system. However, existing trajectory based methods lack of robustness, also oversimplify the process of information construction and fusion betwee…

Binary ClassificationPrediction

Viewport Proposal CNN for 360deg Video Quality Assessment

2019-06-01 · CVPR 2019 6 · Chen Li, Mai Xu, Lai Jiang, Shanyi Zhang 외

Recent years have witnessed the growing interest in visual quality assessment (VQA) for 360deg video. Unfortunately, the existing VQA approaches do not consider the facts that: 1) Observers only see viewports of 360deg v…

Saliency PredictionVideo Quality AssessmentVisual Question Answering (VQA)

Viewport Prediction for Volumetric Video Streaming by Exploring Video Saliency and Trajectory Information

2023-11-28 · Jie Li, Zhixin Li, Zhi Liu, Pengyuan Zhou 외

Volumetric video, also known as hologram video, is a novel medium that portrays natural content in Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It is expected to be the next-gen video technology …

Mixed RealityPredictionSaliency Detection