Deterministic information Ho

Consider a set of alternatives: X = {a1, a2, a3, …aK}
- When the outcome is a3, we say x = a3

Ho(X) is the amount of information needed to specify the outcome of X with no error
- Ho(X) = log2½X½
  - Logs always use base 2
  - Units are bits

Relationship between bits and binary digits
- B = {0, 1}
- BM = binary strings of length M
- Ho(BM) = log2½BM½= M bits
  - Bits and binary digits are equivalent

Consider a set of alternatives: X = {a1, a2, a3, …aK}