Boosting algorithms have been widely applied in the machine vision systems. Two fundamental issues that have to be solved in these systems are how much training data and how many Boosting rounds are needed to achieve a desired performance. We view the Boosting algorithm as a nonlinear estimation scheme that estimates a strong classifier from a given training sample set (that is generated by sampling a true unknown distribution), the weak classifiers, and the number of Boosting rounds T. The performance characterization of this estimator involves the derivation of the classification error statistics of the trained strong classifier as a function of the training set and the collection of the weak classifiers. Although the convergence and the error bounds for the training error and generalization error of the algorithms have been studied for several years, the estimated bounds are still loose bounds that are only meaningful for large training sets. With no effective tools for determining the error bounds, users are now collecting training samples with as much data as they can afford, with no good way to know if they are sufficient. In this paper, we characterize the classification error statistics of the trained strong classifier as a function of the true distributions of classes, the collection of the weak classifiers, and the size of the training set. We show that the statistics can be numerically computed and the results are more accurate than previous bounds in the literature. Theoretical results are verified through the simulations. Face detection is used as a case study to illustrate the application of the theory on real data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    On the small sample performance of Boosted classifiers


    Contributors:
    Li, W. (author) / Gao, X. (author) / Zhu, Y. (author) / Visvanathan Ramesh, (author) / Boult, T.E. (author)


    Publication date :

    2005-01-01


    Size :

    181127 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Boosted translation-tolerable classifiers for fast object detection

    Zheng, W. / Liang, L. / Chang, H. et al. | British Library Online Contents | 2012


    A cascade of boosted generative and discriminative classifiers for vehicle detection

    Negri, Pablo / Clady, Xavier / Shehzad Muhammad Haniv et al. | Tema Archive | 2008


    On the Importance of Accurate Weak Classifier Learning for Boosted Weak Classifiers

    Overett, G.M. / Petersson, L. | British Library Conference Proceedings | 2008