We treat feature selection and basis selection in a unified framework by introducing the masking matrix. If one considers feature selection as finding a binary mask vector that determines which features participate in the learning process, and similarly, basis selection as finding a binary mask vector that determines which basis vectors are needed for the learning process, then the masking matrix is, in particular, the outer product of the feature masking vector and the basis masking vector. This representation allows for a joint estimation of both features and basis. In addition, it allows one to select features that appear in only part of the basis functions. This joint selection of feature/basis subset is not possible when using feature selection and basis selection algorithms independently, thus, the masking matrix help extend feature and basis selection methods while blurring the lines between them. The problem of searching for an optimal masking matrix is NP-hand and we offer a sub-optimal probabilistic method to find it. In particular we demonstrate our ideas on the problem of feature and basis selection for SVM classification and show results for the problem of image classification on faces and vehicles.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Joint feature-basis subset selection


    Contributors:
    Avidan, S. (author)


    Publication date :

    2004-01-01


    Size :

    343835 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Joint Feature-Basis Subset Selection

    Avidan, S. / IEEE Computer Society | British Library Conference Proceedings | 2004


    Automated feature generation for sensor subset selection

    STURLAUGSON LIESSMAN / ETHINGTON JAMES M | European Patent Office | 2025

    Free access

    AUTOMATED FEATURE GENERATION FOR SENSOR SUBSET SELECTION

    STURLAUGSON LIESSMAN / ETHINGTON JAMES M | European Patent Office | 2020

    Free access

    Feature subset selection applied to model-free gait recognition

    Dupuis, Y. / Savatier, X. / Vasseur, P. | British Library Online Contents | 2013