Example

• {a, b, c} with P(a) = 1/8, P(b) = 1/4, P(c) = 5/8

  • inf(a) = -log2(1/8) = 3
  • inf(b) = -log2(1/4) = 2
  • inf(c) = -log2(5/8) = .678

• Receiving an “a” has more information than receiving a “b” or “c”.

Previous slide

Next slide

Back to first slide

View graphic version