Example of Codes

• P(a) = 1/3, P(b) = 2/3.

a

b

aa

ab

ba

bb

aaa

aab

aba

abb

baa

bab

bba

bbb

0

1

0/27

1/27

3/27

9/27

5/27

11/27

15/27

19/27

27/27

.000010010...

.000000000...

.000111000...

.001011110...

.010101010...

.011010000...

.100011100...

.101101000...

.111111111...

.000001001... 0 aaa

.000100110... 0001 aab

.001001100... 001 aba

.010000101... 01 abb

.010111110... 01011 baa

tag = (l+r)/2 code

.011110111... 0111 bab

.101000010... 101 bba

.110110100... 11 bbb

.95 bits/symbol

.92 entropy lower bound

Previous slide

Next slide

Back to first slide

View graphic version