Probabilistic information Hd

• Consider a set of alternatives, X = {a1, a2, a3, …aK}, each with an associated probability P(ak)

  • Ensemble X ? (X , P)
    • The aK, each with an associated P(ak)

• Hd (X) is the amount of information needed to specify the outcome of X with allowable error d

  • Units are bits
  • is the minimum cardinality of the ensemble X

Previous slide

Next slide

Back to first slide

View graphic version