๐ญ Entropy ยง = the amount of expected information Alternative definition ยง = the amount of expected surprise