Entropy and Information
Several posts and my classes in thermodynamics equate increase in entropy
with loss of information. Shannon clearly showed that the information
content of a message is zero when its entropy is zero and that its
information content increases with increasing entropy. So entropy increase
leads to more information, which is consistent with the evolution of the
universe from a disordered plasma to one that contains lots of order. Why
does physics continue to get the relationship between entropy and
information backwards?
No comments:
Post a Comment