Calculating entropy at different scales among diverse communication systems
We evaluated the impact of changing the observation scale over the entropy measures for text descriptions. MIDI coded Music, computer code and two human natural languages were studied at the scale of characters, words, and at the Fundamental Scale resulting from adjusting the symbols length used to interpret each text-description until it produced minimum entropy. The results show that the Fundamental Scale method is comparable with the use of words when measuring entropy levels in written texts. However, this method can also be used in communication systems lacking words such as music. Measuring symbolic entropy at the fundamental scale allows to calculate quantitatively, relative levels of complexity for different communication systems. The results open novel vision on differences among the structure of the communication systems studied.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Accurate and thermodynamically consistent hydrogen equation of state for planetary modeling with flow matching
Accurate determination of the equation of state of dense hydrogen is essential for understanding gas giants. Currently, there is still no consensus on methods for calculating its entropy, which play a fundamental role an…
A Time-Varying Information Measure for Tracking Dynamics of Neural Codes in a Neural Ensemble
The amount of information that differentially correlated spikes in a neural ensemble carry is not the same; the information of different types of spikes is associated with different features of the stimulus. By calculati…
DecoderInformation entropy as an anthropomorphic concept
According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view e…
DiversityMining Relations among Cross-Frame Affinities for Video Semantic Segmentation
The essence of video semantic segmentation (VSS) is how to leverage temporal information for prediction. Previous efforts are mainly devoted to developing new techniques to calculate the cross-frame affinities such as op…
Optical Flow EstimationSemantic SegmentationVideo Semantic SegmentationAn Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audio
When the task of locating manipulation regions in partially-fake audio (PFA) involves cross-domain datasets, the performance of deep learning models drops significantly due to the shift between the source and target doma…
Data AugmentationDiversityDomain AdaptationMixture-of-Experts+1