Skip to main content
Log in

Fast learning complex-valued classifiers for real-valued classification problems

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

In this paper, we present two fast learning complex-valued, single hidden layer neural network classifiers namely, ‘bilinear branch-cut complex-valued extreme learning machine (BB-CELM)’ and ‘phase encoded complex-valued extreme learning machine (PE-CELM)’ to solve real-valued classification problems. BB-CELM and PE-CELM use the bilinear transformation with a branch-cut at 2π and the phase encoded transformation, respectively, at the input layer to transform the feature space from the real domain to complex domain (\({\Re \rightarrow \mathbb{C}}\)). A complex-valued activation function of the type of hyperbolic secant employed at the hidden layer maps the complex-valued feature space to a hyper dimensional complex space (\({\mathbb{C}^m \rightarrow \mathbb{C}^K\quad K > m}\)). BB-CELM and PE-CELM are trained by choosing the hidden layer parameters randomly and computing the output weights analytically. Therefore, these classifiers require minimal computational effort during the training process. The performances of these classifiers are evaluated on a set of benchmark classification problems from the UCI machine learning repository and a practical acoustic emission signal classification problem. The results of the performance study highlight the superior classification ability of BB-CELM and PE-CELM classifiers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. It must be noted here that all the input features are scaled in [0, 1], i.e., \(\mathbf{x}_t \in \Re[0,1], t = 1 \ldots N.\)

  2. http://www.eagle.tamut.edu/faculty/igor/Downloads.htm

References

  1. Aizenberg I, Moraga C (2007) Multilayer feedforward neural network based on multi-valued neurons (MLMVN) and a backpropagation learning algorithm. Soft Comput 11(2):169–183

    Article  Google Scholar 

  2. Aizenberg I, Paliy DV, Zurada JM, Astola JT (2008) Blur identification by multilayer neural network based on multivalued neurons. IEEE Transact Neural Netw 19(5):883–898

    Article  Google Scholar 

  3. Amin MF, Islam MM, Murase K (2009) Ensemble of single-layered complex-valued neural networks for classification tasks. Neurocomputing 72(10-12):2227–2234

    Article  Google Scholar 

  4. Amin MF, Murase K (2009) Single-layered complex-valued neural network for real-valued classification problems. Neurocomputing 72(4-6):945–955

    Article  Google Scholar 

  5. Babu R, Suresh S, Savitha R (2012) Human action recognition using a fast learning complex-valued classifier. Neurocomputing 89:202–212

    Article  Google Scholar 

  6. Blake C, Merz C (1998) UCI repository of machine learning databases. Department of information and computer sciences, University of California, Irvine, (http://archive.ics.uci.edu/ml/)

  7. Bregains JC, Ares F (2006) Analysis, synthesis and diagnosis of antenna arrays through complex-valued neural networks. Microw Opt Technol Letters 48(8):1512–1515

    Article  Google Scholar 

  8. Cristianini N, Taylor JS (2000) An Introduction to support vector machines. Cambridge University Press, Cambridge, UK

    Google Scholar 

  9. Haykin S (1998) Neural networks: a comprehensive foundation. Prentice Hall, New Jersey, USA

    Google Scholar 

  10. Huang GB, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74(1–3):155–163

    Article  Google Scholar 

  11. Huang GB, Saratchandran P, Sundararajan N (2004) An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Transact Syst Man Cybern Part B Cybern 34(6):2284–2292

    Article  Google Scholar 

  12. Jianping D, Sundararajan N, Saratchandran P (2000) Complex-valued minimal resource allocation network for nonlinear signal processing. Int J Neural Syst 10(2):95–106

    Google Scholar 

  13. Kim T, Adali T (2002) Fully complex multi-layer perceptron network for nonlinear signal processing. J VLSI Signal Process 32(1/2):29–43

    Article  MATH  Google Scholar 

  14. Kim T, Adali T (2003) Approximation by fully complex multi-layer perceptrons. Neural Comput 15(7):1641–1666

    Article  MATH  Google Scholar 

  15. Lee C, Landgrebe DA (1997) Decision boundary feature extraction for neural networks. IEEE Transact Neural Netw 8(1):75–83

    Article  Google Scholar 

  16. Li MB, Huang GB, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68(1–4):306–314

    Article  Google Scholar 

  17. Li MB, Huang GB, Saratchandran P, Sundararajan N (2006) Complex-valued growing and pruning RBF neural networks for communication channel equalisation. IEE Proc Vis Imag Signal Process 153(4):411–418

    Article  Google Scholar 

  18. Liang NY, Huang GB, Saratchandran P, Sundararajan N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Transact Neural Netw 17(6):1411–1423

    Article  Google Scholar 

  19. Nitta T (2003) The computational power of complex-valued neuron. Artificial Neural Networks and Neural Information Processing ICANN/ICONIP. Lect Notes Comput Sci 2714:993–1000

    Article  Google Scholar 

  20. Nitta T (2003) Solving the xor problem and the detection of symmetry using a single complex-valued neuron. Neural Netw 16(8):1101–1105

    Article  MathSciNet  Google Scholar 

  21. Nitta T (2004) Orthogonality of decision boundaries of complex-valued neural networks. Neural Comput 16(1):73–97

    Article  MATH  Google Scholar 

  22. Omkar SN, Karanth UR (2008) Rule extraction for classification of acoustic emission signals using ant colony optimisation. Eng Appl Artif Intell 21(8):1381–1388

    Article  Google Scholar 

  23. Omkar SN, Suresh S, Raghavendra TR, Mani V (2002) Acoustic emission signal classification using fuzzy C-means clustering. In: Proceedings of the ICONIP’02, 9th International Conference on Neural Information Processing, vol 4, pp 1827–1831

  24. Savitha R, Suresh S, Sundararajan N (2009) A fully complex-valued radial basis function network and its learning algorithm. Int J Neural Syst 19(4):253–267

    Article  Google Scholar 

  25. Savitha R, Suresh S, Sundararajan N (2011) A fast learning complex-valued neural classifier for real-valued classification problems. International Joint Conference on Neural Networks (IJCNN 2011) pp 2243–2249

  26. Savitha R, Suresh S, Sundararajan N (2012) Fast learning circular complex-valued extreme learning machine (CC-ELM) for real-valued classification problems. Inf Sci 187(1):277–290

    Article  MathSciNet  Google Scholar 

  27. Savitha R, Suresh S, Sundararajan N (2012) A meta-cognitive learning algorithm for a fully complex-valued relaxation network. Neural Netw 32:209–218

    Article  MATH  Google Scholar 

  28. Savitha R, Suresh S, Sundararajan N (2012) Meta-cognitive learning in fully complex-valued radial basis function network. Neural Comput 24(5):1297–1328

    Article  MathSciNet  Google Scholar 

  29. Savitha R, Suresh S, Sundararajan N, Kim HJ (2011) A fully complex-valued radial basis function classifier for real-valued classification. Neurocomputing 78(1):104–110

    Article  Google Scholar 

  30. Savitha R, Vigneshwaran S, Suresh S, Sundararajan N (2009) Adaptive beamforming using complex-valued radial basis function neural networks. IEEE Region 10 Conference, 2009 (TENCON 2009) pp 1–6

  31. Shen C, Lajos H, Tan S (2008) Symmetric complex-calued RBF receiver for multiple-antenna-aided wireless systems. IEEE Transact Neural Netw 19(9):1659–1665

    Article  Google Scholar 

  32. Suresh S, Babu RV, Kim HJ (2009) No-reference image quality assessment using modified extreme learning machine classifier. Appl Soft Comput 9(2):541–552

    Article  Google Scholar 

  33. Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019

    Article  Google Scholar 

  34. Suresh S, Omkar SN, Mani V, Menaka C (2004) Classification of acoustic emission signal using genetic programming. J Aerosp Sci Technol 56(1):26–41

    Google Scholar 

  35. Suresh S, Omkar SN, Mani V, Prakash TNG (2003) Lift coefficient prediction at high angle of attack using recurrent neural network. Aerosp Sci Technol 7(8):595–602

    Article  MATH  Google Scholar 

  36. Suresh S, Savitha R, Sundararajan N (2011) A sequential learning algorithm for complex-valued self-regulating resource allocation network-CSRAN. IEEE Transact Neural Netw 22(7):1061–1072

    Article  Google Scholar 

  37. Suresh S, Sundararajan N, Saratchandran P (2008) Risk-sensitive loss functions for sparse multi-category classification problems. Inf Sci 178(12):2621–2638

    Article  MathSciNet  MATH  Google Scholar 

  38. Suresh S, Sundararajan N, Saratchandran P (2008) A sequential multi-category classifier using radial basis function networks. Neurocomputing 71(7–9):1345–1358

    Article  Google Scholar 

  39. Yingwei L, Sundararajan N, Saratchandran P (1997) A sequential learning scheme for function approximation using minimal radial basis function neural networks. Neural Comput 9(2):461–478

    Article  MATH  Google Scholar 

  40. Zhang GB (2000) Neural network for classification: A survey. IEEE Transact Syst Man Cybern Part C Appl Rev 30(4):451–462

    Article  Google Scholar 

Download references

Acknowledgments

The first and second authors would like to thank the Ministry of Education (MoE), Singapore, for the financial support through the Academic Research Fund (AcRF) Tier I grant to conduct the study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Savitha.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Savitha, R., Suresh, S. & Sundararajan, N. Fast learning complex-valued classifiers for real-valued classification problems. Int. J. Mach. Learn. & Cyber. 4, 469–476 (2013). https://doi.org/10.1007/s13042-012-0112-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-012-0112-x

Keywords

Navigation