Skip to main content

Current Feature Selection Techniques in Statistical Pattern Recognition

  • Conference paper
Book cover Computer Recognition Systems

Part of the book series: Advances in Soft Computing ((AINSC,volume 30))

Abstract

The paper addresses the problem of feature selection (abbreviated FS in the sequel) in statistical pattern recognition with particular emphasis to recent knowledge. Besides over-viewing advances in methodology it attempts to put them into a taxonomical framework. The methods discussed include the latest variants of the Branch & Bound algorithm, enhanced sub-optimal techniques and the simultaneous semi-parametric probability density function modeling and feature space selection method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Devijver PA, Kittler J (1982) Pattern Recognition: A Statistical Approach, Prentice-Hall

    Google Scholar 

  2. Duda RO, Hart PE, Stork DG (2000) Pattern Classification, 2nd Ed., Wiley-Interscience

    Google Scholar 

  3. Ferri FJ, Pudil P, Hatef M, Kittler J (1994) Comparative Study of Techniques for Large-Scale Feature Selection, Gelsema ES, Kanal LN (eds.) Pattern Recognition in Practice IV, Elsevier Science B.V., 403–413

    Google Scholar 

  4. Fukunaga K (1990) Introduction to Statistical Pattern Recognition, Academic Press

    Google Scholar 

  5. Chen X (2003) An Improved Branch and Bound Algorithm for Feature Selection, Pattern Recognition Letters 24(12):1925–1933

    Article  Google Scholar 

  6. Jain AK, Zongker D (1997) Feature Selection: Evaluation, Application and Small Sample Performance, IEEE Transactions on Pattern Analysis and Machine Intelligence 19(2):153–158

    Article  Google Scholar 

  7. Kohavi R, John GH (1997) Wrappers for Feature Subset Selection. Artificial Intelligence 97(1–2):273–324

    Article  MATH  Google Scholar 

  8. Kudo M, Sklansky J (2000) Comparison of Algorithms that Select Features for Pattern Classifiers, Pattern Recognition 33(1):25–41

    Article  Google Scholar 

  9. McLachlan GJ (1992) Discriminant Analysis and Statistical Pattern Recognition, John Wiley & Sons, New York

    Google Scholar 

  10. Murphy PM, Aha DW (1994) UCI Repository of Machine Learning Databases [ftp.ics.uci.edu]. University of California, Department of Information and Computer Science, Irvine, CA

    Google Scholar 

  11. Narendra PM, Fukunaga K (1977) A Branch and Bound Algorithm for Feature Subset Selection. IEEE Transactions on Computers 26:917–922

    Article  MATH  Google Scholar 

  12. Novovičová J, Pudil P, Kittler J (1996) Divergence Based Feature Selection for Multimodal Class Densities, IEEE Transactions on Pattern Analysis and Machine Intelligence 18(2):218–223

    Article  Google Scholar 

  13. Pudil P, Novovičová J, Kittler J (1994) Floating Search Methods in Feature Selection, Pattern Recognition Letters 15(11):1119–1125

    Article  Google Scholar 

  14. Pudil P, Novovičová J, Kittler J (1994) Simultaneous Learning of Decision Rules and Important Attributes for Classification Problems in Image Analysis, Image and Vision Computing 12:193–198

    Article  Google Scholar 

  15. Ripley B (1996) Pattern Recognition and Neural Networks, Cambridge University Press, Cambridge, Massachusetts

    MATH  Google Scholar 

  16. Siedlecki W, Sklansky J (1988) On Automatic Feature Selection, International Journal of Pattern Recognition and Artificial Intelligence 2(2):197–220

    Article  Google Scholar 

  17. Somol P, Pudil P, Novovičová J, Paclík P (1999) Adaptive Floating Search Methods in Feature Selection, Pattern Recognition Letters 20(11,12,13):1157–1163

    Article  Google Scholar 

  18. Somol P, Pudil P (2000) Oscillating Search Algorithms For Feature Selection, In: Proc 15th IAPR International Conference on Pattern Recognition, Barcelona, Spain, 406–409

    Google Scholar 

  19. Somol P, Pudil P (2002) Feature Selection Toolbox. Pattern Recognition 35(12):2749–2759

    Article  MATH  Google Scholar 

  20. Somol P, Pudil P, Kittler J (2004) Fast Branch & Bound Algorithms for Optimal Feature Selection. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(7):900–912

    Article  Google Scholar 

  21. Somol P, Pudil P, Grim J (2004) On Prediction Mechanisms in Fast Branch & Bound Algorithms. Lecture Notes in Computer Science 3138, Springer, Berlin, 716–724

    Google Scholar 

  22. Theodoridis S, Koutroumbas K (2003) Pattern Recognition, 2nd Ed., Academic Press

    Google Scholar 

  23. Wang Z, Yang J, Li G (2003) An Improved Branch & Bound Algorithm in Feature Selection, Lecture Notes in Computer Science LNCS 2639, Springer, 549–556.

    Google Scholar 

  24. Webb A (2002) Statistical Pattern Recognition, 2nd Ed., John Wiley & Sons

    Google Scholar 

  25. Yu B, Yuan B (1993) A More Efficient Branch and Bound Algorithm for Feature Selection. Pattern Recognition 26:883–889

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pudil, P., Somol, P. (2005). Current Feature Selection Techniques in Statistical Pattern Recognition. In: Kurzyński, M., Puchała, E., Woźniak, M., żołnierek, A. (eds) Computer Recognition Systems. Advances in Soft Computing, vol 30. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-32390-2_5

Download citation

  • DOI: https://doi.org/10.1007/3-540-32390-2_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-25054-8

  • Online ISBN: 978-3-540-32390-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics