paper-with-me

Papers

Distributed Radiance Fields for Edge Video Compression and Metaverse Integration in Autonomous Driving

2024-02-22 · Eugen Šlapak, Matúš Dopiriak, Mohammad Abdullah Al Faruque, Juraj Gazda, Marco Levorato

The metaverse is a virtual space that combines physical and digital elements, creating immersive and connected digital worlds. For autonomous mobility, it enables new possibilities with edge computing and digital twins (DTs) that offer virtual prototyping, prediction, and more. DTs can be created with 3D scene reconstruction methods that capture the real world's geometry, appearance, and dynamics. However, sending data for real-time DT updates in the metaverse, such as camera images and videos from connected autonomous vehicles (CAVs) to edge servers, can increase network congestion, costs, and latency, affecting metaverse services. Herein, a new method is proposed based on distributed radiance fields (RFs), multi-access edge computing (MEC) network for video compression and metaverse DT updates. RF-based encoder and decoder are used to create and restore representations of camera images. The method is evaluated on a dataset of camera images from the CARLA simulator. Data savings of up to 80% were achieved for H.264 I-frame - P-frame pairs by using RFs instead of I-frames, while maintaining high peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) qualitative metrics for the reconstructed images. Possible uses and challenges for the metaverse and autonomous mobility are also discussed.

📄 PDF Abstract BibTeX arXiv:2402.14642

Code (0)

등록된 구현이 없습니다.

Tasks

3D Scene ReconstructionAutonomous DrivingAutonomous VehiclesDecoderEdge-computingSSIMVideo Compression

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Resolution-Agnostic Neural Compression for High-Fidelity Portrait Video Conferencing via Implicit Radiance Fields

2024-02-26 · Yifei Li, Xiaohong Liu, Yicong Peng, Guangtao Zhai 외

Video conferencing has caught much more attention recently. High fidelity and low bandwidth are two major objectives of video compression for video conferencing applications. Most pioneering methods rely on classic video…

Video Compression

NeVRF: Neural Video-based Radiance Fields for Long-duration Sequences

2023-12-10 · Minye Wu, Tinne Tuytelaars

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes …

Continual LearningNeRFNovel View Synthesis

TeTriRF: Temporal Tri-Plane Radiance Fields for Efficient Free-Viewpoint Video

2023-12-10 · CVPR 2024 1 · Minye Wu, Zehao Wang, Georgios Kouros, Tinne Tuytelaars

Neural Radiance Fields (NeRF) revolutionize the realm of visual media by providing photorealistic Free-Viewpoint Video (FVV) experiences, offering viewers unparalleled immersion and interactivity. However, the technology…

NeRF

JointRF: End-to-End Joint Optimization for Dynamic Neural Radiance Field Representation and Compression

2024-05-23 · Zihan Zheng, Houqiang Zhong, Qiang Hu, Xiaoyun Zhang 외

Neural Radiance Field (NeRF) excels in photo-realistically static scenes, inspiring numerous efforts to facilitate volumetric videos. However, rendering dynamic and long-sequence radiance fields remains challenging due t…

Feature CompressionNeRF

CATRF: Codec-Adaptive TriPlane Radiance Fields for Volumetric Content Delivery

2026-05-18 · Tung-I Chen, Lingdong Wang, Subhransu Maji, Ramesh K. Sitaraman arxiv

Volumetric media promises next-generation content delivery applications, but its bandwidth demand remains a key bottleneck. Implicit and hybrid volumetric representations reduce model sizes, yet still require careful cod…