A universal tradeoff between power, precision and speed in physical communication
Maximizing the speed and precision of communication while minimizing power dissipation is a fundamental engineering design goal. Also, biological systems achieve remarkable speed, precision and power efficiency using poorly understood physical design principles. Powerful theories like information theory and thermodynamics do not provide general limits on power, precision and speed. Here we go beyond these classical theories to prove that the product of precision and speed is universally bounded by power dissipation in any physical communication channel whose dynamics is faster than that of the signal. Moreover, our derivation involves a novel connection between friction and information geometry. These results may yield insight into both the engineering design of communication devices and the structure and function of biological signaling systems.
Code (0)
등록된 구현이 없습니다.
Tasks
FrictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Representation range needs for 16-bit neural network training
Deep learning has grown rapidly thanks to its state-of-the-art performance across a wide range of real-world applications. While neural networks have been trained using IEEE-754 binary32 arithmetic, the rapid growth of c…
On the Expressive Power and Limitations of Multi-Layer SSMs
We study the expressive power and limitations of multi-layer state-space models (SSMs). First, we show that multi-layer SSMs face fundamental limitations in compositional tasks, revealing an inherent gap between SSMs and…
Quantized Neural Network Inference with Precision Batching
We present PrecisionBatching, a quantized inference algorithm for speeding up neural network execution on traditional hardware platforms at low bitwidths without the need for retraining or recalibration. PrecisionBatchin…
GPULanguage ModelingLanguage ModellingNatural Language Inference+1Speed-detachment tradeoff and its effect on track bound transport of single motor protein
The transportation of the cargoes in biological cells is primarily driven by the motor proteins on filamentous protein tracks. The stochastic nature of the motion of motor protein often leads to its spontaneous detachmen…
Rapid Sequence Identification of Potential Pathogens Using Techniques from Sparse Linear Algebra
The decreasing costs and increasing speed and accuracy of DNA sample collection, preparation, and sequencing has rapidly produced an enormous volume of genetic data. However, fast and accurate analysis of the samples rem…