paper-with-me

홈 › Papers

Inter-Frame Compression for Dynamic Point Cloud Geometry Coding

2022-07-25 · Anique Akhtar, Zhu Li, Geert Van der Auwera

Efficient point cloud compression is essential for applications like virtual and mixed reality, autonomous driving, and cultural heritage. This paper proposes a deep learning-based inter-frame encoding scheme for dynamic point cloud geometry compression. We propose a lossy geometry compression scheme that predicts the latent representation of the current frame using the previous frame by employing a novel feature space inter-prediction network. The proposed network utilizes sparse convolutions with hierarchical multiscale 3D feature learning to encode the current frame using the previous frame. The proposed method introduces a novel predictor network for motion compensation in the feature domain to map the latent representation of the previous frame to the coordinates of the current frame to predict the current frame's feature embedding. The framework transmits the residual of the predicted features and the actual features by compressing them using a learned probabilistic factorized entropy model. At the receiver, the decoder hierarchically reconstructs the current frame by progressively rescaling the feature embedding. The proposed framework is compared to the state-of-the-art Video-based Point Cloud Compression (V-PCC) and Geometry-based Point Cloud Compression (G-PCC) schemes standardized by the Moving Picture Experts Group (MPEG). The proposed method achieves more than 88% BD-Rate (Bjontegaard Delta Rate) reduction against G-PCCv20 Octree, more than 56% BD-Rate savings against G-PCCv20 Trisoup, more than 62% BD-Rate reduction against V-PCC intra-frame encoding mode, and more than 52% BD-Rate savings against V-PCC P-frame-based inter-frame encoding mode using HEVC. These significant performance gains are cross-checked and verified in the MPEG working group.

📄 PDF Abstract BibTeX arXiv:2207.12554

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDecoderMixed RealityMotion Compensation

Methods 이 논문이 사용한 방법론

Sparse Convolutions 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

D-DPCC: Deep Dynamic Point Cloud Compression via 3D Motion Prediction

2022-05-02 · Tingyu Fan, Linyao Gao, Yiling Xu, Zhu Li 외

The non-uniformly distributed nature of the 3D dynamic point cloud (DPC) brings significant challenges to its high-efficient inter-frame compression. This paper proposes a novel 3D sparse convolution-based Deep Dynamic P…

Motion CompensationMotion Estimationmotion predictionOptical Flow Estimation

Motion Estimation Techniques for Volumetric Video Attribute Compression

2026-07-03 · Haoran Hong, Eduardo Pavez, Antonio Ortega, Ryosuke Watanabe 외 arxiv

Point cloud compression relies on techniques to compress both geometry and attributes. Motion-based approaches for dynamic solid point cloud geometry compression within the geometry-based point cloud compression (G-PCC) …

Point Clouds

VoxelContext-Net: An Octree based Framework for Point Cloud Compression

2021-05-05 · CVPR 2021 1 · Zizheng Que, Guo Lu, Dong Xu

In this paper, we propose a two-stage deep learning framework called VoxelContext-Net for both static and dynamic point cloud compression. Taking advantages of both octree based methods and voxel based schemes, our appro…

Decoder

4DAC: Learning Attribute Compression for Dynamic Point Clouds

2022-04-25 · Guangchi Fang, Qingyong Hu, Yiling Xu, Yulan Guo

With the development of the 3D data acquisition facilities, the increasing scale of acquired 3D point clouds poses a challenge to the existing data compression techniques. Although promising performance has been achieved…

AttributeData CompressionMotion CompensationMotion Estimation

Learning Dynamic Point Cloud Compression via Hierarchical Inter-frame Block Matching

2023-05-09 · Shuting Xia, Tingyu Fan, Yiling Xu, Jenq-Neng Hwang 외

3D dynamic point cloud (DPC) compression relies on mining its temporal context, which faces significant challenges due to DPC's sparsity and non-uniform structure. Existing methods are limited in capturing sufficient tem…

Feature CorrelationMotion CompensationMotion EstimationOptical Flow Estimation+1