Skip to main content

Ensembles of Feature Subspaces for Object Detection

  • Conference paper
Advances in Neural Networks – ISNN 2009 (ISNN 2009)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5552))

Included in the following conference series:

Abstract

Detecting objects (e.g., people, faces) from images is an important problem in many applications of machine learning and computer vision. Most past work has concentrated on the issues of feature extraction and classification, where less attention has been paid to the selection and manipulation of features. In this paper, the method of ensembles of feature subspaces is applied to construct multiple classifiers for object detection. Specifically, random subspace with sum rule and principal component analysis (PCA) are taken as a case study. Individual support vector machine classifiers are constructed using randomly selected eigenvectors from PCA spaces. Then sum rule is adopted to combine the prediction of individual classifiers. The performance of the proposed method is tested on two applications: pedestrian detection and face detection, which show promising results. We also compare sum rule with majority voting in their performance for weighting individual classifiers, and find that sum rule is superior.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Dietterich, T.G.: Machine Learning Research: Four Current Directions. AI Magazine 18, 97–136 (1997)

    Google Scholar 

  2. Tsymbal, A., Pechenizkiy, M., Cunningham, P.: Diversity in Search Strategies for Ensemble Feature Selection. Information Fusion 6, 83–98 (2005)

    Article  Google Scholar 

  3. Sun, S., Zhang, C.: Subspace Ensembles for Classification. Physica A: Statistical Mechanics and its Applications 385, 199–207 (2007)

    Article  MathSciNet  Google Scholar 

  4. Ho, T.K.: The Random Subspace Method for Constructing Decision Forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 832–844 (1998)

    Article  Google Scholar 

  5. Wang, X., Tang, X.: Using Random Subspace to Combine Multiple Features for Face Recognition. In: 6th International Conference on Automatic Face and Gesture Recognition, pp. 284–289. IEEE Press, New York (2004)

    Google Scholar 

  6. Sun, S., Zhang, C.: The Selective Random Subspace Predictor for Traffic Flow Forecasting. IEEE Transactions on Intelligent Transportation Systems 8, 367–373 (2007)

    Article  Google Scholar 

  7. Sun, S., Zhang, C., Lu, Y.: The Random Electrode Selection Ensemble for EEG Signal Classification. Pattern Recognition 41, 1663–1675 (2008)

    Article  MATH  Google Scholar 

  8. Munder, S., Gavrila, D.M.: An Experimantal Study on Pedestrian Classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 1863–1868 (2006)

    Article  Google Scholar 

  9. Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3, 71–86 (1991)

    Article  Google Scholar 

  10. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, New York (2000)

    MATH  Google Scholar 

  11. Vapnik, V.: Statistical Learning Theory. John Wiley & Sons, New York (1998)

    MATH  Google Scholar 

  12. Schölkopf, B., Smola, A.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. The MIT Press, Cambridge (2001)

    Google Scholar 

  13. Kittler, J., Hatef, M., Duin, R., Matas, J.: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 226–239 (1998)

    Article  Google Scholar 

  14. Sun, Z., Bebis, G., Miller, R.: On-road Vehicle Detection: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 694–711 (2006)

    Article  Google Scholar 

  15. Papageorgiou, C., Poggio, T.: A Trainable System for Object Detection. International Journal of Computer Vision 38, 15–33 (2000)

    Article  MATH  Google Scholar 

  16. CBCL Face Database #1. MIT Center For Biological and Computation Learning, http://www.ai.mit.edu/projects/cbcl

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sun, S. (2009). Ensembles of Feature Subspaces for Object Detection. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01510-6_113

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01510-6_113

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01509-0

  • Online ISBN: 978-3-642-01510-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics