Lower Bounds for Passive and Active Learning

Unified information-theoretic machinery for deriving lower bounds for passive and active learning schemes is developed and first known lower bounds based on the capacity function rather than the disagreement coefficient are provided.