Skip to main content
SpringerLink
Log in

Fast Image Recognition Based on Independent Component Analysis and Extreme Learning Machine

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Nowadays, image recognition has become a highly active research topic in cognitive computation community, due to its many potential applications. Generally, the image recognition task involves two subtasks: image representation and image classification. Most feature extraction approaches for image representation developed so far regard independent component analysis (ICA) as one of the essential means. However, ICA has been hampered by its extremely expensive computational cost in real-time implementation. To address this problem, a fast cognitive computational scheme for image recognition is presented in this paper, which combines ICA and the extreme learning machine (ELM) algorithm. It tries to solve the image recognition problem at a much faster speed by using ELM not only in image classification but also in feature extraction for image representation. As an example, our proposed approach is applied to the face image recognition with detailed analysis. Firstly, common feature hypothesis is introduced to extract the common visual features from universal images by the traditional ICA model in the offline recognition process, and then ELM is used to simulate ICA for the purpose of facial feature extraction in the online recognition process. Lastly, the resulting independent feature representation of the face images extracted by ELM rather than ICA will be fed into the ELM classifier, which is composed of numerous single hidden layer feed-forward networks. Experimental results on Yale face database and MNIST digit database have shown the good performance of our proposed approach, which could be comparable to the state-of-the-art techniques at a much faster speed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Notes

  1. Throughout this paper, the superscript in X′ denotes the transpose of X.

  2. The database can be downloaded from http://cvc.yale.edu/projects/yalefaces/yalefaces.html.

  3. The database can be downloaded from http://yann.lecun.com/exdb/mnist/.

  4. The image sets can be downloaded from http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html.

  5. The Matlab codes can be downloaded from http://www.ifp.illinois.edu/~jyang29/ScSPM.htm.

  6. The Matlab codes can be downloaded from http://www.cis.hut.fi/projects/tsp/index.php?page=OPELM.

  7. The image sets can be downloaded from http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html.

  8. The image sets can be downloaded from http://www1.ustb.edu.cn/resb/en/index.htm.

  9. The image sets can be downloaded from http://www.cad.zju.edu.cn/home/dengcai/Data/MLData.html.

References

  1. Taylor JG. Cognitive computation. Cogn Comput. 2009;1(1):4–16.

    Article  Google Scholar 

  2. Cambria E, Hussain A. Sentic Computing: Techniques, Tools, and Applications. Springer Briefs in Cogn Comput. Dordrecht, Netherlands: Springer 2012.

  3. Wang QF, Cambria E, Liu CL, Hussain A. Common sense knowledge for handwritten Chinese recognition. Cogn Comput. 2013;5(2):234–42.

    Article  Google Scholar 

  4. Rakover SŚ, Cahlon B. Face recognition: cognitive and computational processes. Amsterdam: John Benjamins; 2001.

    Book  Google Scholar 

  5. Jain AK, Duin RPW, Mao J. Statistical pattern recognition: a review. IEEE Trans Pattern Anal. 2000;22:4–37.

    Article  Google Scholar 

  6. Zhao W, Chellappa R, Phillips PJ, Rosenfeld A. Face recognition: a literature survey. ACM Comput Surv. 2003;35:399–458.

    Article  Google Scholar 

  7. Yambor WS. Analysis of PCA-based and Fisher discriminant-based image recognition algorithms. Master Thesis, Colorado State University, 2000.

  8. Shakhnarovich G, Moghaddam B. Face recognition in subspaces. In handbook of face recognition. New York: Springer; 2011.

    Google Scholar 

  9. Wang X, Tang X. A unified framework for subspace face recognition. IEEE Trans Pattern Anal. 2004;26:1222–8.

    Article  Google Scholar 

  10. Vasilescu MAO, Terzopoulos D. Multilinear subspace analysis of image ensembles. In: 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2003, p. II-93–99.

  11. Brunelli R, Poggio T. Face recognition: features versus templates. IEEE Trans Pattern Anal. 1993;15:1042–52.

    Article  Google Scholar 

  12. Liu C, Wechsler H. Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process. 2002;1:467–76.

    Google Scholar 

  13. Hjelmås E. Feature-based face recognition. In: Proceedings norwegian image processing and pattern recognition conference, 2000.

  14. Jutten C, Herault J. Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture. Signal Process. 1991;24:1–10.

    Article  Google Scholar 

  15. Comon P. Independent component analysis, a new concept. Signal Process. 1994;36:287–314.

    Article  Google Scholar 

  16. Te-Won L. Independent component analysis, theory and applications. Boston: Kluwer Academic; 1998.

    Google Scholar 

  17. Hyvärinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13:411–30.

    Article  PubMed  Google Scholar 

  18. Jolliffe IT. Principal component analysis. New York: Springer; 2002.

    Google Scholar 

  19. Shlens J. A tutorial on principal component analysis. In: Technical report, systems neurobiology laboratory, University of California at San Diego; 2005.

  20. Zou H, Hastie T, Tibshirani R. Sparse principal component analysis. J Comput Graph Stat. 2006;15:265–86.

    Article  Google Scholar 

  21. Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006;70:489–501.

    Article  Google Scholar 

  22. Huang GB, Wang DH, Lan Y. Extreme learning machines: a survey. Int J Mach Learn Cybern. 2011;2:107–22.

    Article  Google Scholar 

  23. Huang GB, Zhu QY, Siew CK. Extreme learning machine: a new learning scheme of feed forward neural networks. In: Proc. Int. Joint Conf. Neural Netw. (IJCNN2004), Budapest, Hungary; 2004: 985–990.

  24. Huang GB, Chen L, Siew CK. Universal approximation using incremental constructive feed forward networks with random hidden nodes. IEEE Trans Neural Netw. 2006;17(4):879–92.

    Article  PubMed  Google Scholar 

  25. Huang GB, Chen L. Convex incremental extreme learning machine. Neurocomputing. 2007;70:3056–62.

    Article  Google Scholar 

  26. Huang GB, Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing. 2008;71:3460–8.

    Article  Google Scholar 

  27. Huang GB, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern. 2012;42(2):513–29.

    Article  Google Scholar 

  28. Huang GB, Li MB, Chen L, Siew CK. Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing. 2008;71:576–83.

    Article  Google Scholar 

  29. Liang NY, Huang GB, Saratchandran P, Sundararajan N. A fast and accurate online sequential learning algorithm for feed forward networks. IEEE Trans Neural Netw. 2006;17(6):1411–23.

    Article  PubMed  Google Scholar 

  30. Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Trans Neural Netw. 2010;21(1):158–62.

    Article  PubMed  Google Scholar 

  31. Zhao Z, Liu B, Li W. Image classification based on extreme learning machine. IEIT J Adapt Dynam Comput. 2012;1:5–11.

    Article  Google Scholar 

  32. Zhao J, Zhou Z, Cao F. Human face recognition based on ensemble of polyharmonic extreme learning machine. Neural Comput Appl. 2013. doi:10.1007/s00521-013-1356-4.

  33. Marques I, Graña M. Face recognition with lattice independent component analysis and extreme learning machines. Soft Comput. 2012;16:1525–37.

    Article  Google Scholar 

  34. Olshausen BA. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature. 1996;381:607–9.

    Article  CAS  PubMed  Google Scholar 

  35. Field DJ. What is the goal of sensory coding? Neural Comput. 1994;6:559–601.

    Article  Google Scholar 

  36. Bartlett MS. Face image analysis by unsupervised learning. Dordrecht: Kluwer Academic; 2001.

    Book  Google Scholar 

  37. Bartlett MS, Movellan JR, Sejnowski TJ. Face recognition by independent component analysis. IEEE Trans Neural Netw. 2002;13:1450–64.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  38. Barlow HB. Unsupervised learning. Neural Comput. 1989;1:295–311.

    Article  Google Scholar 

  39. Hyvärinen A, Oja E. A fast fixed-point algorithm for independent component analysis. Neural Comput. 1997;9:1483–92.

    Article  Google Scholar 

  40. Hansen LK, Salamon P. Neural network ensemble. IEEE Trans Pattern Anal Mach Intell. 1990;12(10):993–1001.

    Article  Google Scholar 

  41. Cai D, He X, Hu Y, Han J, Huang T. Learning a spatially smooth subspace for face recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2007: 1–7.

  42. Mankiewicz R. The story of mathematics. Princeton: Princeton Univ. Press; 2004.

    Google Scholar 

  43. Chow SL. Statistical significance: rationale, validity and utility. London, UK: Sage; 1996.

    Google Scholar 

Download references

Acknowledgments

This work is partially supported by the High Technology Research and Development Program of China (2006AA09Z231), Natural Science Foundation of China (41176076, 31202036, 51075377), and the Science and Technology Development Program of Shandong Province (2008GG1055011, BS2009HZ006).

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Ocean University of China, Qingdao, 266100, Shandong, China

    Shujing Zhang, Bo He, Rui Nian, Jing Wang, Bo Han & Guang Yuan

  2. School of Information and Computer Science, Aalto University, FI-00076, Aalto, Finland

    Amaury Lendasse

Authors
  1. Shujing Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rui Nian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jing Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bo Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Amaury Lendasse
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Guang Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bo He.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, S., He, B., Nian, R. et al. Fast Image Recognition Based on Independent Component Analysis and Extreme Learning Machine. Cogn Comput 6, 405–422 (2014). https://doi.org/10.1007/s12559-014-9245-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-014-9245-4

Keywords

Search

Navigation