Abstract
In this paper, we present two fast learning complex-valued, single hidden layer neural network classifiers namely, ‘bilinear branch-cut complex-valued extreme learning machine (BB-CELM)’ and ‘phase encoded complex-valued extreme learning machine (PE-CELM)’ to solve real-valued classification problems. BB-CELM and PE-CELM use the bilinear transformation with a branch-cut at 2π and the phase encoded transformation, respectively, at the input layer to transform the feature space from the real domain to complex domain (\({\Re \rightarrow \mathbb{C}}\)). A complex-valued activation function of the type of hyperbolic secant employed at the hidden layer maps the complex-valued feature space to a hyper dimensional complex space (\({\mathbb{C}^m \rightarrow \mathbb{C}^K\quad K > m}\)). BB-CELM and PE-CELM are trained by choosing the hidden layer parameters randomly and computing the output weights analytically. Therefore, these classifiers require minimal computational effort during the training process. The performances of these classifiers are evaluated on a set of benchmark classification problems from the UCI machine learning repository and a practical acoustic emission signal classification problem. The results of the performance study highlight the superior classification ability of BB-CELM and PE-CELM classifiers.
Similar content being viewed by others
Notes
It must be noted here that all the input features are scaled in [0, 1], i.e., \(\mathbf{x}_t \in \Re[0,1], t = 1 \ldots N.\)
References
Aizenberg I, Moraga C (2007) Multilayer feedforward neural network based on multi-valued neurons (MLMVN) and a backpropagation learning algorithm. Soft Comput 11(2):169–183
Aizenberg I, Paliy DV, Zurada JM, Astola JT (2008) Blur identification by multilayer neural network based on multivalued neurons. IEEE Transact Neural Netw 19(5):883–898
Amin MF, Islam MM, Murase K (2009) Ensemble of single-layered complex-valued neural networks for classification tasks. Neurocomputing 72(10-12):2227–2234
Amin MF, Murase K (2009) Single-layered complex-valued neural network for real-valued classification problems. Neurocomputing 72(4-6):945–955
Babu R, Suresh S, Savitha R (2012) Human action recognition using a fast learning complex-valued classifier. Neurocomputing 89:202–212
Blake C, Merz C (1998) UCI repository of machine learning databases. Department of information and computer sciences, University of California, Irvine, (http://archive.ics.uci.edu/ml/)
Bregains JC, Ares F (2006) Analysis, synthesis and diagnosis of antenna arrays through complex-valued neural networks. Microw Opt Technol Letters 48(8):1512–1515
Cristianini N, Taylor JS (2000) An Introduction to support vector machines. Cambridge University Press, Cambridge, UK
Haykin S (1998) Neural networks: a comprehensive foundation. Prentice Hall, New Jersey, USA
Huang GB, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74(1–3):155–163
Huang GB, Saratchandran P, Sundararajan N (2004) An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Transact Syst Man Cybern Part B Cybern 34(6):2284–2292
Jianping D, Sundararajan N, Saratchandran P (2000) Complex-valued minimal resource allocation network for nonlinear signal processing. Int J Neural Syst 10(2):95–106
Kim T, Adali T (2002) Fully complex multi-layer perceptron network for nonlinear signal processing. J VLSI Signal Process 32(1/2):29–43
Kim T, Adali T (2003) Approximation by fully complex multi-layer perceptrons. Neural Comput 15(7):1641–1666
Lee C, Landgrebe DA (1997) Decision boundary feature extraction for neural networks. IEEE Transact Neural Netw 8(1):75–83
Li MB, Huang GB, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68(1–4):306–314
Li MB, Huang GB, Saratchandran P, Sundararajan N (2006) Complex-valued growing and pruning RBF neural networks for communication channel equalisation. IEE Proc Vis Imag Signal Process 153(4):411–418
Liang NY, Huang GB, Saratchandran P, Sundararajan N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Transact Neural Netw 17(6):1411–1423
Nitta T (2003) The computational power of complex-valued neuron. Artificial Neural Networks and Neural Information Processing ICANN/ICONIP. Lect Notes Comput Sci 2714:993–1000
Nitta T (2003) Solving the xor problem and the detection of symmetry using a single complex-valued neuron. Neural Netw 16(8):1101–1105
Nitta T (2004) Orthogonality of decision boundaries of complex-valued neural networks. Neural Comput 16(1):73–97
Omkar SN, Karanth UR (2008) Rule extraction for classification of acoustic emission signals using ant colony optimisation. Eng Appl Artif Intell 21(8):1381–1388
Omkar SN, Suresh S, Raghavendra TR, Mani V (2002) Acoustic emission signal classification using fuzzy C-means clustering. In: Proceedings of the ICONIP’02, 9th International Conference on Neural Information Processing, vol 4, pp 1827–1831
Savitha R, Suresh S, Sundararajan N (2009) A fully complex-valued radial basis function network and its learning algorithm. Int J Neural Syst 19(4):253–267
Savitha R, Suresh S, Sundararajan N (2011) A fast learning complex-valued neural classifier for real-valued classification problems. International Joint Conference on Neural Networks (IJCNN 2011) pp 2243–2249
Savitha R, Suresh S, Sundararajan N (2012) Fast learning circular complex-valued extreme learning machine (CC-ELM) for real-valued classification problems. Inf Sci 187(1):277–290
Savitha R, Suresh S, Sundararajan N (2012) A meta-cognitive learning algorithm for a fully complex-valued relaxation network. Neural Netw 32:209–218
Savitha R, Suresh S, Sundararajan N (2012) Meta-cognitive learning in fully complex-valued radial basis function network. Neural Comput 24(5):1297–1328
Savitha R, Suresh S, Sundararajan N, Kim HJ (2011) A fully complex-valued radial basis function classifier for real-valued classification. Neurocomputing 78(1):104–110
Savitha R, Vigneshwaran S, Suresh S, Sundararajan N (2009) Adaptive beamforming using complex-valued radial basis function neural networks. IEEE Region 10 Conference, 2009 (TENCON 2009) pp 1–6
Shen C, Lajos H, Tan S (2008) Symmetric complex-calued RBF receiver for multiple-antenna-aided wireless systems. IEEE Transact Neural Netw 19(9):1659–1665
Suresh S, Babu RV, Kim HJ (2009) No-reference image quality assessment using modified extreme learning machine classifier. Appl Soft Comput 9(2):541–552
Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019
Suresh S, Omkar SN, Mani V, Menaka C (2004) Classification of acoustic emission signal using genetic programming. J Aerosp Sci Technol 56(1):26–41
Suresh S, Omkar SN, Mani V, Prakash TNG (2003) Lift coefficient prediction at high angle of attack using recurrent neural network. Aerosp Sci Technol 7(8):595–602
Suresh S, Savitha R, Sundararajan N (2011) A sequential learning algorithm for complex-valued self-regulating resource allocation network-CSRAN. IEEE Transact Neural Netw 22(7):1061–1072
Suresh S, Sundararajan N, Saratchandran P (2008) Risk-sensitive loss functions for sparse multi-category classification problems. Inf Sci 178(12):2621–2638
Suresh S, Sundararajan N, Saratchandran P (2008) A sequential multi-category classifier using radial basis function networks. Neurocomputing 71(7–9):1345–1358
Yingwei L, Sundararajan N, Saratchandran P (1997) A sequential learning scheme for function approximation using minimal radial basis function neural networks. Neural Comput 9(2):461–478
Zhang GB (2000) Neural network for classification: A survey. IEEE Transact Syst Man Cybern Part C Appl Rev 30(4):451–462
Acknowledgments
The first and second authors would like to thank the Ministry of Education (MoE), Singapore, for the financial support through the Academic Research Fund (AcRF) Tier I grant to conduct the study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Savitha, R., Suresh, S. & Sundararajan, N. Fast learning complex-valued classifiers for real-valued classification problems. Int. J. Mach. Learn. & Cyber. 4, 469–476 (2013). https://doi.org/10.1007/s13042-012-0112-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-012-0112-x