Review: Learning
Learning as Search
- Search in the space of hypotheses
- Hill climbing in space of decision trees
- Complete search in conjunctive hypothesis representation
Notion of Bias
- Restricted set of hypotheses (or preference order)
- Strong bias means
- Greatly reduced sample complexity
- Can’t represent as many concepts
Ensembles of classifiers:
- Bagging, Boosting, Cross validated committees