Abstract
Detecting objects (e.g., people, faces) from images is an important problem in many applications of machine learning and computer vision. Most past work has concentrated on the issues of feature extraction and classification, where less attention has been paid to the selection and manipulation of features. In this paper, the method of ensembles of feature subspaces is applied to construct multiple classifiers for object detection. Specifically, random subspace with sum rule and principal component analysis (PCA) are taken as a case study. Individual support vector machine classifiers are constructed using randomly selected eigenvectors from PCA spaces. Then sum rule is adopted to combine the prediction of individual classifiers. The performance of the proposed method is tested on two applications: pedestrian detection and face detection, which show promising results. We also compare sum rule with majority voting in their performance for weighting individual classifiers, and find that sum rule is superior.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Dietterich, T.G.: Machine Learning Research: Four Current Directions. AI Magazine 18, 97–136 (1997)
Tsymbal, A., Pechenizkiy, M., Cunningham, P.: Diversity in Search Strategies for Ensemble Feature Selection. Information Fusion 6, 83–98 (2005)
Sun, S., Zhang, C.: Subspace Ensembles for Classification. Physica A: Statistical Mechanics and its Applications 385, 199–207 (2007)
Ho, T.K.: The Random Subspace Method for Constructing Decision Forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 832–844 (1998)
Wang, X., Tang, X.: Using Random Subspace to Combine Multiple Features for Face Recognition. In: 6th International Conference on Automatic Face and Gesture Recognition, pp. 284–289. IEEE Press, New York (2004)
Sun, S., Zhang, C.: The Selective Random Subspace Predictor for Traffic Flow Forecasting. IEEE Transactions on Intelligent Transportation Systems 8, 367–373 (2007)
Sun, S., Zhang, C., Lu, Y.: The Random Electrode Selection Ensemble for EEG Signal Classification. Pattern Recognition 41, 1663–1675 (2008)
Munder, S., Gavrila, D.M.: An Experimantal Study on Pedestrian Classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 1863–1868 (2006)
Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3, 71–86 (1991)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, New York (2000)
Vapnik, V.: Statistical Learning Theory. John Wiley & Sons, New York (1998)
Schölkopf, B., Smola, A.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. The MIT Press, Cambridge (2001)
Kittler, J., Hatef, M., Duin, R., Matas, J.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 226–239 (1998)
Sun, Z., Bebis, G., Miller, R.: On-road Vehicle Detection: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 694–711 (2006)
Papageorgiou, C., Poggio, T.: A Trainable System for Object Detection. International Journal of Computer Vision 38, 15–33 (2000)
CBCL Face Database #1. MIT Center For Biological and Computation Learning, http://www.ai.mit.edu/projects/cbcl
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, S. (2009). Ensembles of Feature Subspaces for Object Detection. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01510-6_113
Download citation
DOI: https://doi.org/10.1007/978-3-642-01510-6_113
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01509-0
Online ISBN: 978-3-642-01510-6
eBook Packages: Computer ScienceComputer Science (R0)