Information channels

• X and Y form a joint ensemble

• I(X;Y) is the average mutual information between X and Y

• The channel may add noise

  • Corrupting our symbols

channel

x

y

Input

Output

H(X) ? information

in input ensemble X

H(X) ? information

in input ensemble X

I(X;Y) ? what we know

about X given Y

Previous slide

Next slide

Back to first slide

View graphic version