Information Gain

• Measure of expected reduction in entropy

• Resulting from splitting along an attribute

Gain(S,A) = Entropy(S) - (|Sv| / |S|) Entropy(Sv)

Where Entropy(S) = -P log2(P) - N log2(N)

?

v ? Values(A)

Previous slide

Next slide

Back to first slide

View graphic version