Notes on joint entropies

• H(X½Y) <= H(X)

  • With equality iff X and Y are statistically independent

• H(X½Y) >= 0

  • With equality iff x is a function of y (or x = 1)

• H(XY) = H(X½Y) + H(Y) = H(Y½X) + H(X)

• H(Xn) = nH(X)

Previous slide

Next slide

Back to first slide

View graphic version