Decision trees are attractive classifiers due to their high execution speed. But trees derived with traditional methods often cannot be grown to arbitrary complexity for possible loss of generalization accuracy on unseen data. The limitation on complexity usually means suboptimal accuracy on training data. Following the principles of stochastic modeling, we propose a method to construct tree-based classifiers whose capacity can be arbitrarily expanded for increases in accuracy for both training and unseen data. The essence of the method is to build multiple trees in randomly selected subspaces of the feature space. Trees in, different subspaces generalize their classification in complementary ways, and their combined classification can be monotonically improved. The validity of the method is demonstrated through experiments on the recognition of handwritten digits.
Random decision forests
Proceedings of 3rd International Conference on Document Analysis and Recognition ; 1 ; 278-282 vol.1
1995-01-01
598273 byte
Conference paper
Electronic Resource
English
British Library Conference Proceedings | 1995
|Efficient Gaussian process classification using random decision forests
British Library Online Contents | 2011
|Large-scale Gaussian process classification using random decision forests
British Library Online Contents | 2012
|Predicting incident duration using random forests
Taylor & Francis Verlag | 2020
|Travel Time Reliability Prediction Using Random Forests
Transportation Research Record | 2023
|