Abstract
In order to adequately extract and utilize identifiable information in the image to improve classification accuracy, extreme learning machine with multi-structure and auto encoding receptive fields (ELM-MAERF) is proposed based on local receptive fields based extreme learning machine (ELM-LRF). The ELM-MAERF is mainly composed of two convolution-pooling layers, parallel encoders and classifier. In the two convolution-pooling layers, the local receptive fields and the fully connected receptive fields are trained by utilizing the theory of ELM autoencoder. The trained receptive fields are used to extract local features, multi-channel features and fully connected features. Parallel encoders are used to adequately encode and fuse these features. The classifier trained by the approximate empirical kernel map is used to classify the fusion features, which can effectively avoid the computational difficulties caused by processing large database. To demonstrate the effectiveness of ELM-MAERF, experiments are performed on four databases: Yale, MNIST, NORB and Caltech. The experimental results demonstrate the validity of trained receptive fields and structures in ELM-MAERF. Compared with the improved method based on ELM-LRF, the classification accuracy is improved by ELM-MAERF.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997). Eigenfaces vs fisherfaces: Recognition using class specific linear projection. New Haven: Yale University.
Ding, S., Guo, L., & Hou, Y. (2017). Extreme learning machine with kernel model based on deep learning. Neural Computing and Applications, 28(8), 1975–1984.
Han, H. G., Wang, L. D., & Qiao, J. F. (2014). Hierarchical extreme learning machine for feedforward neural network. Neurocomputing, 128, 128–135.
He, B., Song, Y., Zhu, Y., Sha, Q., Shen, Y., Yan, T., et al. (2018). Local receptive fields based extreme learning machine with hybrid filter kernels for image classification. Multidimensional Systems and Signal Processing, 30, 1–21.
Hinton, G. E., Osindero, S., & Teh, Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18(7), 1527–1554.
Hinton, G. E., & Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786), 504–507.
Huang, G. B. (2015). What are extreme learning machines? Filling the gap between Frank Rosenblatt’s dream and John von Neumann’s puzzle. Cognitive Computation, 7(3), 263–278.
Huang, G. B., Bai, Z., Kasun, L. L. C., & Vong, C. M. (2015). Local receptive fields based extreme learning machine. Computational Intelligence Magazine, 10(2), 18–29.
Huang, G. B., Chen, L., & Siew, C. K. (2006a). Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks, 17(4), 879–892.
Huang, J., Yu, Z. L., Cai, Z., Gu, Z., Cai, Z., Gao, W., et al. (2017). Extreme learning machine with multi-scale local receptive fields for texture classification. Multidimensional Systems and Signal Processing, 28(3), 995–1011.
Huang, G. B., Zhou, H., Ding, X., & Zhang, R. (2012). Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42(2), 513–529.
Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2004). Extreme learning machine: a new learning scheme of feedforward neural networks. In Proceedings of 2004 IEEE international joint conference on neural networks (Vol. 2, pp. 985–990): IEEE.
Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2006b). Extreme learning machine: Theory and applications. Neurocomputing, 70(1–3), 489–501.
Kasun, L. L. C., Zhou, H., Huang, G., & Vong, C. M. (2013). Representational learning with extreme learning machine for big data. IEEE Intelligent Systems, 28(6), 31–34.
Khellal, A., Ma, H., & Fei, Q. (2018). Convolutional neural network based on extreme learning machine for maritime ships recognition in infrared images. Sensors, 18(5), 1490.
LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324.
LeCun, Y., Huang, F. J., & Bottou, L. (2004). Learning methods for generic object recognition with invariance to pose and lighting. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004, (Vol. 2, pp. II–104): IEEE.
Li, F. F., Fergus, R., & Perona, P. (2007). Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1), 59–70.
Li, M. B., Huang, G. B., Saratchandran, P., & Sundararajan, N. (2005). Fully complex extreme learning machine. Neurocomputing, 68, 306–314.
Li, G., Niu, P., Duan, X., & Zhang, X. (2014). Fast learning network: a novel artificial neural network with a fast learning speed. Neural Computing and Applications, 24(7–8), 1683–1695.
Li, H., Zhao, H., & Li, H. (2018). Neural-response-based extreme learning machine for image classification. IEEE Transactions on Neural Networks and Learning Systems, 99, 1–14.
Liu, H., Li, F., Xu, X., & Sun, F. (2018). Multi-modal local receptive field extreme learning machine for object recognition. Neurocomputing, 277, 4–11.
Pang, S., & Yang, X. (2016). Deep convolutional extreme learning machine and its application in handwritten digit classification. Computational Intelligence and Neuroscience, 2016, 1–10.
Tang, J., Deng, C., & Huang, G. B. (2016). Extreme learning machine for multilayer perceptron. IEEE Transactions on Neural Networks and Learning Systems, 27(4), 809–821.
Vong, C. M., Chen, C., & Wong, P. K. (2018). Empirical kernel map-based multilayer extreme learning machines for representation learning. Neurocomputing, 310, 265–276.
Wang, X., & Han, M. (2014). Multivariate time series prediction based on multiple kernel extreme learning machine. In 2014 International joint conference on neural networks (IJCNN), (pp. 198–201): IEEE.
Yan, D., Chu, Y., Zhang, H., & Liu, D. (2018). Information discriminative extreme learning machine. Soft Computing, 22(2), 677–689.
Zhang, S., He, B., Nian, R., Wang, J., Han, B., Lendasse, A., et al. (2014). Fast image recognition based on independent component analysis and extreme learning machine. Cognitive Computation, 6(3), 405–422.
Acknowledgments
This work is supported by National Natural Science Foundation of China (No. 51641609).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wu, C., Li, Y., Zhao, Z. et al. Extreme learning machine with multi-structure and auto encoding receptive fields for image classification. Multidim Syst Sign Process 31, 1277–1298 (2020). https://doi.org/10.1007/s11045-020-00708-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-020-00708-1