UPDF AI

Improved bounds on the sample complexity of learning

Yi Li,Philip M. Long,A. Srinivasan

2000 · DOI: 10.1006/jcss.2000.1741
ACM-SIAM Symposium on Discrete Algorithms · 216 Citations

TLDR

A new general upper bound on the number of examples required to estimate all of the expectations of a set of random variables uniformly well is presented and implies improved bounds on the sample complexity of learning according to Haussler's decision theoretic model.

Abstract

We present a new general upper bound on the number of examples required to estimate all of the expectations of a set of random variables uniformly well. The quality of the estimates is measured using a variant of the relative error proposed by Haussler and Pollard. We also show that our bound is within a constant factor of the best possible. Our upper bound implies improved bounds on the sample complexity of learning according to Haussler's decision theoretic model.