paper-with-me

Papers

Learning-based Prediction, Rendering and Transmission for Interactive Virtual Reality in RIS-Assisted Terahertz Networks

2021-07-27 · Xiaonan Liu, Yansha Deng, Chong Han, Marco Di Renzo

The quality of experience (QoE) requirements of wireless Virtual Reality (VR) can only be satisfied with high data rate, high reliability, and low VR interaction latency. This high data rate over short transmission distances may be achieved via abundant bandwidth in the terahertz (THz) band. However, THz waves suffer from severe signal attenuation, which may be compensated by the reconfigurable intelligent surface (RIS) technology with programmable reflecting elements. Meanwhile, the low VR interaction latency may be achieved with the mobile edge computing (MEC) network architecture due to its high computation capability. Motivated by these considerations, in this paper, we propose a MEC-enabled and RIS-assisted THz VR network in an indoor scenario, by taking into account the uplink viewpoint prediction and position transmission, MEC rendering, and downlink transmission. We propose two methods, which are referred to as centralized online Gated Recurrent Unit (GRU) and distributed Federated Averaging (FedAvg), to predict the viewpoints of VR users. In the uplink, an algorithm that integrates online Long-short Term Memory (LSTM) and Convolutional Neural Networks (CNN) is deployed to predict the locations and the line-of-sight and non-line-of-sight statuses of the VR users over time. In the downlink, we further develop a constrained deep reinforcement learning algorithm to select the optimal phase shifts of the RIS under latency constraints. Simulation results show that our proposed learning architecture achieves near-optimal QoE as that of the genie-aided benchmark algorithm, and about two times improvement in QoE compared to the random phase shift selection scheme.

📄 PDF Abstract BibTeX arXiv:2107.12943

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningEdge-computing

Similar Papers 제목 키워드 기반

Keep It Real: a Window to Real Reality in Virtual Reality

2020-04-21 · IJCAI 2020 4 · Baihan Lin

This paper proposed a new interaction paradigm in the virtual reality (VR) environments, which consists of a virtual mirror or window projected onto a virtual surface, representing the correct perspective geometry of a m…

Deep Billboards towards Lossless Real2Sim in Virtual Reality

2022-08-08 · Naruya Kondo, So Kuroki, Ryosuke Hyakuta, Yutaka Matsuo 외

An aspirational goal for virtual reality (VR) is to bring in a rich diversity of real world objects losslessly. Existing VR applications often convert objects into explicit 3D models with meshes or point clouds, which al…

DiversityNeural Rendering

Resource Allocation and Resolution Control in the Metaverse with Mobile Augmented Reality

2022-09-28 · Peiyuan Si, Jun Zhao, Huimei Han, Kwok-Yan Lam 외

With the development of blockchain and communication techniques, the Metaverse is considered as a promising next-generation Internet paradigm, which enables the connection between reality and the virtual world. The key t…

syGlass: Interactive Exploration of Multidimensional Images Using Virtual Reality Head-mounted Displays

2018-04-23 · Stanislav Pidhorskyi, Michael Morehead, Quinn Jones, George Spirou 외

The quest for deeper understanding of biological systems has driven the acquisition of increasingly larger multidimensional image datasets. Inspecting and manipulating data of this complexity is very challenging in tradi…

A Multimodal Dialogue System for Medical Decision Support inside Virtual Reality

2017-08-01 · WS 2017 8 · Alex Prange, er, Margarita Chikobava, Peter Poller 외

We present a multimodal dialogue system that allows doctors to interact with a medical decision support system in virtual reality (VR). We integrate an interactive visualization of patient records and radiology image dat…