💭 Entropy § = the amount of expected information Alternative definition § = the amount of expected surprise