We treat feature selection and basis selection in a unified framework by introducing the masking matrix. If one considers feature selection as finding a binary mask vector that determines which features participate in the learning process, and similarly, basis selection as finding a binary mask vector that determines which basis vectors are needed for the learning process, then the masking matrix is, in particular, the outer product of the feature masking vector and the basis masking vector. This representation allows for a joint estimation of both features and basis. In addition, it allows one to select features that appear in only part of the basis functions. This joint selection of feature/basis subset is not possible when using feature selection and basis selection algorithms independently, thus, the masking matrix help extend feature and basis selection methods while blurring the lines between them. The problem of searching for an optimal masking matrix is NP-hand and we offer a sub-optimal probabilistic method to find it. In particular we demonstrate our ideas on the problem of feature and basis selection for SVM classification and show results for the problem of image classification on faces and vehicles.
Joint feature-basis subset selection
2004-01-01
343835 byte
Conference paper
Electronic Resource
English
Joint Feature-Basis Subset Selection
British Library Conference Proceedings | 2004
|Automated feature generation for sensor subset selection
European Patent Office | 2025
|AUTOMATED FEATURE GENERATION FOR SENSOR SUBSET SELECTION
European Patent Office | 2020
|Feature subset selection applied to model-free gait recognition
British Library Online Contents | 2013
|Feature Subset Selection for Multi-class SVM Based Image Classification
Springer Verlag | 2007
|