Skip to main content

Advertisement

SpringerLink
Log in

Two novel hybrid Self-Organizing Map based emotional learning algorithms

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Emotions play an important role in human decision-making process, and consequently, they should be embedded into the reasoning process in our efforts to model human reactions. Adnan Khashman et al. have proposed an emotional backpropagation (EmBP) learning algorithm and have successfully applied it to several practical pattern recognition tasks. However, the design of the emotional input values to the EmBP is not reasonable and may thus cause the failure of its entire implementation. Aimed at improving this weakness, we propose a novel self-organizing map-based emotional neural network (EmSOM) learning algorithm. In contrast to EmBP, the emotional input values of EmSOM are determined based upon its correspondingly associated SOM blocks, and moreover, the network hierarchy has been taken into account in its design, thus improving the deficiencies of EmBP to a certain extent. Furthermore, we incorporate a sparse online SOM (SOR-SOM) algorithm into our emotional neural network learning algorithm and establish a hybrid sparse online relational SOM-based emotional neural network (Em-SOR-SOM) model, so that those advantages of SOR-SOM can be exploited to further boost the recognition performance of the model. The EmSOM and Em-SOR-SOM algorithms have been compared with SBP and EmBP, and several other recent algorithms, and their effectiveness and efficiency have been numerically confirmed by the experiments we presented on the ORL face database and three benchmark credit datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Zhu X (2010) Emotion Recognition of EMG Based on BP neural network. In: Presented at proceedings of the second international symposium on networking and network security, Jinggangshan, P. R. China

  2. Levine DS (2007) Neural network modeling of emotion. Phys Life Rev 4:37–63

    Article  Google Scholar 

  3. Khashman A (2008) A modified backpropagation learning algorithm with added emotional coefficients. IEEE Trans Neural Netw 19:1896–1909

    Article  Google Scholar 

  4. Olkiewicz KA, Markowska-Kaczmar U (2010) Emotion-based image retrieval—an artificial neural network approach. In: Presented at proceedings of the international multiconference on computer science and information technology

  5. Dai Q (2013) Back-propagation with diversive curiosity: an automatic conversion from search stagnation to exploration. Appl Soft Comput 13:483–495

    Article  Google Scholar 

  6. Ioannou SV, Raouzaiou AT, Tzouvaras VA, Mailis TP, Karpouzis KC, Kollias SD (2005) Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Netw 18:423–435

    Article  Google Scholar 

  7. Shi X-F, Wang Z-L, Ping A, Zhang L-K (2011) Artificial emotion model based on reinforcement learning mechanism of neural network. J China Univ Posts Telecommun 18:105–109

    Article  Google Scholar 

  8. Bhatti MW, Wang Y, Guan L (2004) A neural network approach for human emotion recognition in speech. In: Presented at proceedings of the 2004 international symposium on circuits and systems

  9. Kishore KVK, Varma GPS (2011) Hybrid emotional neural network for facial expression classification. Int J Comput Appl 35:8–14

    Google Scholar 

  10. Khanchandani KB, Hussain MA (2009) Emotion recognition using multilayer perceptron and generalized feed forward neural network. J Sci Ind Res 68:367–371

    Google Scholar 

  11. Dai K, Fell HJ, MacAuslan J (2008) Recognizing emotion in speech using neural networks. In: Presented at proceedings of the IASTED international conference on telehealth/assistive technologies

  12. Mériau K, Wartenburger I, Kazzer P, Prehn K, Lammers C-H, van der Meer E, Villringer A, Heekerena HR (2006) A neural network reflecting individual differences in cognitive processing of emotions during perceptual decision making. NeuroImage 33:1016–1027

    Article  Google Scholar 

  13. Khashman A (2009) Blood cell identification using emotional neural networks. J Inf Sci Eng 25:1737–1751

    Google Scholar 

  14. Khashman A (2011) Credit risk evaluation using neural networks: emotional versus conventional models. Appl Soft Comput 11:5477–5484

    Article  Google Scholar 

  15. Baumgartner T, Esslen M, Jancke L (2006) From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int J Psychophysiol 60:34–43

    Article  Google Scholar 

  16. Haykin S (1999) Single-layer perceptrons. Prentice Hall, London

    Google Scholar 

  17. Zhang H, Chow TWS, Wu QMJ (2016) Organizing books and authors by multilayer SOM. IEEE Trans Neural Netw Learn Syst 27:2537–2550

    Article  Google Scholar 

  18. Chow TWS, Rahman MKM (2009) Multilayer SOM with tree-structured data for efficient document retrieval and plagiarism detection. IEEE Trans Neural Netw 20:1385–1402

    Article  Google Scholar 

  19. Olteanu M, Villa-Vialaneix N (2016) Sparse online self-organizing maps for large relational data. In: Merényi E, Mendenhall M, O’Driscoll P (eds) Advances in self-organizing maps and learning vector quantization. Advances in intelligent systems and computing, vol 428. Springer, Cham

    Google Scholar 

  20. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation, vol 1. MIT Press, Cambridge

    MATH  Google Scholar 

  21. Kohonen T (2001) Self-organizing maps, vol 30, 3rd edn. Springer, Berlin

    Book  MATH  Google Scholar 

  22. Mac Donald D, Fyfe C (2000) The kernel self organising map. In: Presented at proceedings of 4th international conference on knowledge-based intelligence engineering systems and applied technologies

  23. Boulet R, Jouve B, Rossi F, Villa N (2008) Batch kernel SOM and related Laplacian methods for social network analysis. Neurocomputing 71:1257–1273

    Article  Google Scholar 

  24. Olteanu M, Villa-Vialaneix N (2015) On-line relational and multiple relational SOM. Neurocomputing 147:15–30

    Article  MATH  Google Scholar 

  25. Hammer B, Hasenfuss A (2010) Topographic mapping of large dissimilarity data sets. Neural Comput 22:2229–2284

    Article  MathSciNet  MATH  Google Scholar 

  26. Hofmann D, Schleif F, Paaßen B, Hammer B (2014) Learning interpretable kernelized prototype-based models. Neurocomputing 141:84–96

    Article  Google Scholar 

  27. Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117

    Article  Google Scholar 

  28. Lee H, Largman Y, Pham P, Ng AY (2009) Unsupervised feature learning for audio classification using convolutional deep belief networks. In: Presented at NIPS’09 proceedings of the 22nd international conference on neural information processing system, Vancouver, Canada

  29. Zhang H, Cao X, Ho JKL, Chow TWS (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13:520–531

    Article  Google Scholar 

  30. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313:504–507

    Article  MathSciNet  MATH  Google Scholar 

  31. Kasun LLC, Zhou H, Huang G-B, Vong CM (2013) Representational learning with extreme learning machine for big data. IEEE Intell Syst 28:31–34

    Article  Google Scholar 

  32. Salakhutdinov R, Larochelle H (2010) Efficient learning of deep boltzmann machines. In: Presented at international conference on artificial intelligence and statistics

  33. Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408

    MathSciNet  MATH  Google Scholar 

  34. Ranzato MA, Poultney C, Chopra S, LeCun Y (2007) Efficient learning of sparse representations with an energy-based model. In: Schölkopf B, Platt J, Hoffman T (eds) Advances in neural information processing systems 19 (NIPS’06). MIT Press, Cambridge, pp 1137–1144

    Google Scholar 

  35. Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Schölkopf B, Platt J, Hoffman T (eds) Advances in neural information processing systems 19 (NIPS’06). MIT Press, Cambridge, pp 153–160

    Google Scholar 

  36. Erhan D, Bengio Y, Courville A, Manzagol P-A, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res 11:625–660

    MathSciNet  MATH  Google Scholar 

  37. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html

  38. Bryliuk D, Starovoitov V (2002) Access control by face recognition using neural networks and negative examples. In: Presented at the 2nd international conference on artificial intelligence, Crimea, Ukraine

  39. Rojas R (1996) Neural networks. A systematic introduction. Springer, Berlin

    MATH  Google Scholar 

  40. Ren Y, Wang Z, Chen Y, Zhao W (2016) Sparsity preserving discriminant projections with applications to face recognition. Math Probl Eng 2016:1–12

    MathSciNet  MATH  Google Scholar 

  41. He Z, Niyogi P (2003) Locality preserving projections. In: Presented at NIPS 16

  42. Cai D, He X, Han J (2007) Spectral regression for efficient regularized subspace learning. In: Presented at IEEE international conference on computer vision, ICCV, Rio de Janeiro, Brazil

  43. Yang J, Zhang D, Frangi AF, Yang J (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26:131–137

    Article  Google Scholar 

  44. Hu D, Feng G, Zhou Z (2007) Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition. Pattern Recognit 40:339–342

    Article  MATH  Google Scholar 

  45. Oh S-K, Yoo S-H, Pedrycz W (2013) Design of face recognition algorithm using PCA-LDA combined for hybrid data pre-processing and polynomial-based RBF neural networks: design and its application. Expert Syst Appl 40:1451–1466

    Article  Google Scholar 

  46. Oh S-K, Yoo S-H, Pedrycz W (2016) A comparative study of feature extraction methods and their application to P-RBF NNs in face recognition problem. Fuzzy Sets Syst 305:131–148

    Article  MathSciNet  Google Scholar 

  47. Shi Y, Ren X, Yang S, Gong P (2016) A generalized kernel fisher discriminant framework used for feature extraction and face recognition. In: Presented at 12th international conference on natural computation, fuzzy systems and knowledge discovery (ICNC-FSKD)

  48. Tang H, Zhu J, Liu T, Zhao M (2016) Research on 2D face representation and recognition. In: Presented at 2016 3rd international conference on information and communication technology for education (ICTE 2016)

  49. http://www.ics.uci.edu/~mlearn/MLRepository.html or ftp.ics.uci.edu:pub/machine-learning-databases

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grants No. 61473150.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China

    Qun Dai & Lin Guo

Authors
  1. Qun Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qun Dai.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dai, Q., Guo, L. Two novel hybrid Self-Organizing Map based emotional learning algorithms. Neural Comput & Applic 31, 2921–2938 (2019). https://doi.org/10.1007/s00521-017-3240-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-3240-0

Keywords

Search

Navigation