Infinite Hypothesis Spaces

• Sample complexity = ln(d /|H|) / ln(1-e)

• Assumes |H| is finite

• Consider

  • Hypothesis represented as a rectangle
  • 
    |H| is infinite, but expressiveness is not! ? bias!

Space of

Instances X

+

+

+

+

+

+

+

+

-

-

-

-

-

-

-

-

-

Previous slide

Next slide

Back to first slide

View graphic version