paper-with-me

홈 › Papers

Image-GS: Content-Adaptive Image Representation via 2D Gaussians

2024-07-02 · Yunxiang Zhang, Bingxuan Li, Alexandr Kuznetsov, Akshay Jindal, Stavros Diolatzis, Kenneth Chen, Anton Sochenov, Anton Kaplanyan, Qi Sun

Neural image representations have emerged as a promising approach for encoding and rendering visual data. Combined with learning-based workflows, they demonstrate impressive trade-offs between visual fidelity and memory footprint. Existing methods in this domain, however, often rely on fixed data structures that suboptimally allocate memory or compute-intensive implicit models, hindering their practicality for real-time graphics applications. Inspired by recent advancements in radiance field rendering, we introduce Image-GS, a content-adaptive image representation based on 2D Gaussians. Leveraging a custom differentiable renderer, Image-GS reconstructs images by adaptively allocating and progressively optimizing a group of anisotropic, colored 2D Gaussians. It achieves a favorable balance between visual fidelity and memory efficiency across a variety of stylized images frequently seen in graphics workflows, especially for those showing non-uniformly distributed features and in low-bitrate regimes. Moreover, it supports hardware-friendly rapid random access for real-time usage, requiring only 0.3K MACs to decode a pixel. Through error-guided progressive optimization, Image-GS naturally constructs a smooth level-of-detail hierarchy. We demonstrate its versatility with several applications, including texture compression, semantics-aware compression, and joint image compression and restoration.

📄 PDF Abstract BibTeX arXiv:2407.01866

Code (0)

등록된 구현이 없습니다.

Tasks

Image Compression

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

A Pixel Is Worth More Than One 3D Gaussians in Single-View 3D Reconstruction

2024-05-30 · Jianghao Shen, Nan Xue, Tianfu Wu

Learning 3D scene representation from a single-view image is a long-standing fundamental problem in computer vision, with the inherent ambiguity in predicting contents unseen from the input view. Built on the recently pr…

3DGS3D ReconstructionNovel View SynthesisSingle-View 3D Reconstruction

Hierarchical Gaussian Mixture Model Splatting for Efficient and Part Controllable 3D Generation

2025-01-01 · CVPR 2025 1 · Qitong Yang, Mingtao Feng, Zijie Wu, Weisheng Dong 외

3D content creation has achieved significant progress in terms of both quality and speed. Although current Gaussian Splatting-based methods can produce 3D objects within seconds, they are still limited by complex pre…

3D GenerationMamba

TSOG: A Format For Temporally And Spatially Ordered Gaussians

2026-07-30 · Shady Gmira, Evangelos Alexiou, Emmanouil Potetsianakis, Emmanuel Thomas arxiv

We propose Temporally and Spatially Ordered Gaussians (TSOG), a format for efficient representation of 4D Gaussian Splatting (4DGS) content. TSOG extends the Spatially Ordered Gaussians (SOG) framework to the temporal do…

A$^2$TG: Adaptive Anisotropic Textured Gaussians for Efficient 3D Scene Representation

2026-01-14 · Sheng-Chi Hsu, Ting-Yu Yen, Shih-Hsuan Hung, Hung-Kuo Chu arxiv

Gaussian Splatting has emerged as a powerful representation for high-quality, real-time 3D scene rendering. While recent works extend Gaussians with learnable textures to enrich visual appearance, existing approaches all…

CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splatting

2025-05-28 · Kornel Howil, Joanna Waczyńska, Piotr Borycki, Tadeusz Dziarmaga 외

Gaussian Splatting (GS) has recently emerged as an efficient representation for rendering 3D scenes from 2D images and has been extended to images, videos, and dynamic 4D content. However, applying style transfer to GS-b…

Style Transfer