In this paper we focus on high dimensional data sets for which the number of dimensions is an order of magnitude higher than the number of objects. From a classifier design standpoint, such small sample size problems have some interesting challenges. First, in any subspace with as many dimensions as objects the data set can be separated with an almost arbitrary linear hyperplane. Second, another important issue is to determine which features are responsible for the phenomenon under consideration. This problem comes down to finding as few features as possible that still can discriminate the classes involved. To attack these problems, we propose the LESS (lowest error in a sparse subspace) classifier. The LESS classifier is a weighted nearest mean classifier that efficiently finds linear discriminants in sparse subspaces, where the subspace is found automatically. In the experiments we compare LESS to related state-of-the-art classifiers like among others linear ridge regression with the LASSO and the support vector machine. It turns out that LESS performs competitively while it uses the fewest features.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A weighted nearest mean classifier for sparse subspaces


    Beteiligte:
    Veenman, C.J. (Autor:in) / Tax, D.M.J. (Autor:in)


    Erscheinungsdatum :

    2005-01-01


    Format / Umfang :

    112462 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Nearest neighbor weighted average customization for modeling faces

    Abeysundera, H. P. | British Library Online Contents | 2013



    Null Spaced-Based LDA with Weighted Dual Personal Subspaces for Face Recognition

    Qiu, X. / Wu, L. | British Library Conference Proceedings | 2005



    Partial Weighted K-nearest Neighbor Classification of Incomplete Data

    Gao, Shengtao / Yuan, Xinying / Tang, Jinlin | IEEE | 2022