paper-with-me

홈 › Papers

The evolution of lossy compression

2015-06-19

In complex environments, there are costs to both ignorance and perception. An organism needs to track fitness-relevant information about its world, but the more information it tracks, the more resources it must devote to memory and processing. Rate-distortion theory shows that, when errors are allowed, remarkably efficient internal representations can be found by biologically-plausible hill-climbing mechanisms. We identify two regimes: a high-fidelity regime where perceptual costs scale logarithmically with environmental complexity, and a low-fidelity regime where perceptual costs are, remarkably, independent of the environment. When environmental complexity is rising, Darwinian evolution should drive organisms to the threshold between the high- and low-fidelity regimes. Organisms that code efficiently will find themselves able to make, just barely, the most subtle distinctions in their environment.

📄 PDF Abstract BibTeX arXiv:1506.06138

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Scaling Training Data with Lossy Image Compression

2024-07-25 · Katherine L. Mentzer, Andrea Montanari

Empirically-determined scaling laws have been broadly successful in predicting the evolution of large machine learning models with training data and number of parameters. As a consequence, they have been useful for optim…

Data CompressionImage Compression

Octree-based Learned Point Cloud Geometry Compression: A Lossy Perspective

2026-03-30 · Kaiyu Zheng, Wei Gao, Huiming Zheng arxiv

Octree-based context learning has recently become a leading method in point cloud compression. However, its potential on lossy compression remains undiscovered. The traditional lossy compression paradigm using lossless o…

Point Clouds

A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compression

2024-09-09 · Nora Hofer, Rainer Böhme

Neural compression has the potential to revolutionize lossy image compression. Based on generative models, recent schemes achieve unprecedented compression rates at high perceptual quality but compromise semantic fidelit…

Image CompressionImage Forensics

Lossy and Lossless (L$^2$) Post-training Model Size Compression

2023-08-08 · Yumeng Shi, Shihao Bai, Xiuying Wei, Ruihao Gong 외

Deep neural networks have delivered remarkable performance and have been widely used in various visual tasks. However, their huge size causes significant inconvenience for transmission and storage. Many previous studies …

Lossy and Lossless (L2) Post-training Model Size Compression

2023-01-01 · ICCV 2023 1 · Yumeng Shi, Shihao Bai, Xiuying Wei, Ruihao Gong 외

Deep neural networks have delivered remarkable performance and have been widely used in various visual tasks. However, their huge sizes cause significant inconvenience for transmission and storage. Many previous stud…