Abstract
Brain emotional learning (BEL) methods are a recently developed class of emotional brain-inspired algorithms, that enjoy feed-forward computational complexity on the order of O(n). BEL methods suffer from a major drawback related to the non-linear problem solving ability, i.e. they cannot solve n-bit parity problems in which \(\hbox {n} \ge 3\). The present paper proposes a competitive BEL (C-BEL) capable of accommodating a higher number of bits in the parity problem. The proposed C-BEL is inspired by the competitive property of neucortex’s neurocircuits. The method is tested on n-bit parity, function approximation and a pattern recognition problem. Various comparisons with the reinforcement BEL (R-BEL), supervised BEL (S-BEL), evolutionary BEL (E-BEL), a Boltzmann machine and a convolutional neural network indicate the superiority of the approach in terms of its higher ability in non-linear problem solving, function approximation and pattern recognition.
Similar content being viewed by others
References
Abdi J, Moshiri B, Abdulhai B, Sedigh AK (2011) Forecasting of short-term traffic flow based on improved neuro-fuzzy models via emotional temporal difference learning algorithm. Eng Appl Artif Intell. doi:10.1016/j.engappai.2011.09.011
Abu-Mostafa YS, St Jacques J (1985) Information capacity of the Hopfield model. IEEE Trans Inf Theory 31(4):461–464
Amin MF, Savitha R, Amin MI, Murase K (2012) Orthogonal least squares based complex-valued functional link network. Neural Netw 32:257–266
Asad M, Farooq U, Gu J, Amin J, Sadaqat A, El-Hawary M, Luo J (2017) Neo-fuzzy supported brain emotional learning based pattern recognizer for classification problems. IEEE Access 5:6951–6967
Aylett R, Louchart S, Dias J, Paiva A, Vala M (2005) FearNot!—an experiment in emergent narrative. In: Intelligent virtual agents, Springer Berlin/Heidelberg pp 305–316
Babaie T, Karimizandi R, Lucas C (2008) Learning based brain emotional intelligence as a new aspect for development of an alarm system. Soft Comput 12(9):857–873
Balkenius C, Morén J (2001) Emotional learning: a computational model of AMYG. Cybern Syst 32(6):611–636
Beheshti Z, Hashim SZM (2010) A review of emotional learning and it’s utilization in control engineering. Int J Adv Soft Comput Appl 2:191–208
Bianchin M, Mello e Souza T, Medina JH, Izquierdo I (1999a) The AMYG is involved in the modulation of long-term memory, but not in working or short-term memory. Neurobiol Learn Mem 71(2):127–131
Binas J, Rutishauser U, Indiveri G, Pfeiffer M (2014) Learning and stabilization of winner-take-all dynamics through interacting excitatory and inhibitory plasticity. Front Comput Neurosci 8:429
Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Gr Image Process 37(1):54–115
César MB, Gonçalves J, Coelho J, de Barros RC (2017) Brain emotional learning based control of a SDOF structural system with a MR damper. In: Garrido P, Soares F, Moreira A (eds) CONTROLO 2016. Lecture notes in electrical engineering, vol 402. Springer, Cham, pp 547–557
Chandra M (2005) Analytical study of a control algorithm based on emotional processing, M.S. Dissertation, Indian Institute of Technology Kanpur
Coultrip R, Granger R, Lynch G (1992) A cortical model of winner-take-all competition via lateral inhibition. Neural Netw 5(1):47–54
Dai Q (2013a) A competitive ensemble pruning approach based on cross-validation technique. Knowl Based Syst 37:394–414
Dai Q (2013b) Back-propagation with diversive curiosity: an automatic conversion from search stagnation to exploration. Appl Soft Comput 13(1):483–495
Dai Q, Song G (2016) A novel supervised competitive learning algorithm. Neurocomputing 191:356–362
Daryabeigi E, Markadeh GRA, Lucas C (2010) Emotional controller (BELBIC) for electric drives—a review, 7–10 Nov., Glendale, AZ, pp 2901–2907, doi:10.1109/IECON.2010.5674934
Dehkordi BM, Kiyoumarsi A, Hamedani P, Lucas C (2011a) A comparative study of various intelligent based controllers for speed control of IPMSM drives in the field-weakening region. Expert Syst Appl 38(10):12643–12653
Dehkordi BM, Parsapoor A, Moallem M, Lucas C (2011b) Sensorless speed control of switched reluctance motor using brain emotional learning based intelligent controller. Energy Convers Manag 52(1):85–96
Dehuri S, Cho SB (2010) Evolutionarily optimized features in functional link neural network for classification. Expert Syst Appl 37(6):4379–4391
Dehuri S, Roy R, Cho SB, Ghosh A (2012) An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification. J Syst Softw 85(6):1333–1345
Douglas Rodney J, Martin Kevan AC (2004) Neuronal circuits of the neocortex. Annu Rev Neurosci 27:419–451
El-Saify MH, El-Garhy AM, El-Sheikh GA (2017) Brain Emotional Learning Based Intelligent Decoupler for Nonlinear Multi-Input Multi-Output Distillation Columns. Math Probl Eng. doi:10.1155/2017/8760351
Fadok JP, Darvas M, Dickerson TM, Palmiter RD (2010) Long-term memory for pavlovian fear conditioning requires dopamine in the nucleus accumbens and basolateral AMYG. PLoS ONE 5(9):e12751
Farhoudi Z, Setayeshi S, Rabiee A (2017) Using learning automata in brain emotional learning for speech emotion recognition. Int J Speech Technol. doi:10.1007/s10772-017-9426-0
Fino E, Yuste R (2011) Dense inhibitory connectivity in neocortex. Neuron 69(6):1188–1203
Gholipour A, Lucas C, Shahmirzadi D (2004) Predicting geomagnetic activity index by brain emotional learning. WSEAS Trans Syst 3m:296–299
Goleman D (2006) Emotional intelligence; why it can matter more than IQ, Bantam
Griggs EM, Young EJ, Rumbaugh G, Miller CA (2013) MicroRNA-182 regulates AMYG-dependent memory formation. J Neurosci 33(4):1734–1740
Grossberg S, Seidman D (2006) Neural dynamics of autistic behaviors: cognitive, emotional, and timing substrates. Psychol Rev 113:483–525
Guyton AC, Hall JE (2010) Textbook of medical physiology: enhanced e-book. Elsevier, Amsterdam
Hardt O, Nader K, Nadel L (2013) Decay happens: the role of active forgetting in memory. Trends Cogn Sci 17(3):111–120
Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259
Jafarzadeh S (2008) Designing PID and BELBIC controllers in path tracking problem. Int J Comput Commun Control, ISSN 1841-9836, E-ISSN 1841-9844, Vol. III (2008), Suppl. issue: Proceedings of ICCCC 2008, pp 343–348
Kalayci TE, Bahrepour M, Meratnia N, Havinga PJ (2011) How wireless sensor networks can benefit from brain emotional learning based intelligent controller (BELBIC). Proc Comput Sci 5:216–223
Khalilian M, Abedi A, Zadeh AD (2012) Position control of hybrid stepper motor using brain emotional controller. Energy Proced 14:1998–2004
Kim JH, Li S, Hamlin AS, McNally GP, Richardson R (2011) Phosphorylation of mitogen-activated protein kinase in the medial prefrontal cortex and the AMYG following memory retrieval or forgetting in developing rats. Neurobiol Learn Mem 97(1):59–68
Kohonen T (1990) The self-organizing map. Proc IEEE 78(9):1464–1480
LeDoux JE (1991) Emotion and the limbic system concept. Concepts Neurosci 2:169–199
LeDoux J (1996) The emotional brain. Simon and Schuster, New York
LeDoux JE (2000) Emotion circuits in the brain. Annu Rev Neurosci 23(1):155–184
Levine DS (2007) Neural network modeling of emotion. Phys Life Rev 4(1):37–63
Li S, Liu B, Li Y (2013) Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks. IEEE Trans Neural Netw Learn Syst 24(2):301–309
Lin BS, Lin BS, Chong FC, Lai F (2006) A functional link network with higher order statistics for signal enhancement. IEEE Trans Signal Process 54(12):4821–4826
Lotfi E, Akbarzadeh TMR (2013a) Brain emotional learning-based pattern recognizer. Cybern Syst 44(5):402–421
Lotfi E, Akbarzadeh TMR (2014a) Adaptive brain emotional decayed learning for online prediction of geomagnetic activity indices. Neurocomputing 126:188–196
Lotfi E, Akbarzadeh TMR (2014) Practical emotional neural networks. Neural Netw. doi:10.1016/j.neunet.2014.06.012
Lotfi E, Akbarzadeh TMR (2016) A winner-take-all approach to emotional neural networks with universal approximation property. Inf Sci 346:369–388
Lotfi E, Keshavarz A (2014d) Gene expression microarray classification using PCA-BEL. Comput Biol Med 54:180–187
Lotfi E, Rezaee AA (2017) A competitive functional link artificial neural network as a universal approximator. Soft Comput. doi:10.1007/s00500-017-2644-1
Lotfi E, Setayeshi S, Taimory S (2014c) A neural basis computational model of emotional brain for online visual object recognition. Appl Artif Intell 28(8):814–834
Lotfi E, Akbarzadeh T M R (2013b) Emotional brain-inspired adaptive fuzzy decayed learning for online prediction problems. In: 2013 IEEE international conference on Fuzzy systems (FUZZ), pp 1–7. IEEE
Lucas C (2011) BELBIC and its industrial applications: towards embedded neuroemotional control code sign. In: Integrated systems, design and technology 2010, Springer Berlin Heidelberg, pp 203–214
Lucas C, Shahmirzadi D, Sheikholeslami N (2004) Introducing BELBIC: brain emotional learning based intelligent controller. Int J Intell Autom Soft Comput 10:11–21
Lumer ED (2000) Effects of spike timing on winner-take-all competition in model cortical circuits. Neural Comput 12(1):181–194
Marinier R, Laird JE (2008) Emotion-driven reinforcement learning. Cognitive Science, 115-120
Marsella SC, Gratch J (2009) EMA: a process model of appraisal dynamics. Cogn Syst Res 10(1):70–90
Mehrabian AR, Lucas C (2005) Emotional learning based intelligent robust adaptive controller for stable uncertain nonlinear systems. Int J Eng Math Sci 2(4):246–252
Mehrabian AR, Lucas C, Roshanian J (2006) Aerospace launch vehicle control: an intelligent adaptive approach. Aerosp Sci Technol 10(2):149–155
Mei Y, Tan G, Liu Z (2017) An improved brain-inspired emotional learning algorithm for fast classification. Algorithms 10(2):70
Milad HS, Farooq U, El-Hawary ME, Asad MU (2017) Neo-fuzzy integrated adaptive decayed brain emotional learning network for online time series prediction. IEEE Access 5:1037–1049
Misra BB, Dehuri S (2007) Functional link artificial neural network for classification task in data mining. J Comput Sci 3(12):948
Moghadam Ahmadi R, Yaghoubi M (2015) Interval emotional neural network for prediction of Kp, AE and Dst geomagnetic activity indices. In: 2015 international congress on technology, communication and knowledge (ICTCK), pp 325–331. IEEE
Morén J (2002) Emotion and learning—a computational model of the AMYG. Ph.D. Thesis, Department of Cognitive Science, Lund University, Lund, Sweden
Morén J, Balkenius C (2000) A computational model of emotional learning in the AMYG. In: , Meyer JA, Berthoz A, Floreano D, Roitblat HL, Wilson SW (Eds.) from animals to animats 6: Proceedings of the 6th international conference on the simulation of adaptive behaviour MIT Press, Cambridge, MA., USA., pp 115–124
Motamed S, Setayeshi S, Rabiee A (2017) Speech emotion recognition based on a modified brain emotional learning model. Biol Inspir Cogn Archit 19:32–38. doi:10.1016/j.bica.2016.12.002
Oster M, Douglas R, Liu SC (2009) Computation with spikes in a winner-take-all network. Neural Comput 21(9):2437–2465
Palm G, Sommer FT (1992) Information capacity in recurrent McCulloch-Pitts networks with sparsely coded memory states. Network Comput Neural Syst 3(2):177–186
Peri RM, Mandal P, Haque AU, Tseng B (2015) Very short-term prediction of wind farm power: an advanced hybrid intelligent approach. In: Industry applications society annual meeting, 2015 IEEE, pp 1–8 IEEE
Pessoa L (2008) On the relationship between emotion and cognition. Nat Rev Neurosci 9(2):148–158
Pessoa L (2009) How do emotion and motivation direct executive control? Trends Cogn Sci 13(4):160–166
Raymundo CR, Johnson CG, Vargas PA (2015, August) An architecture for emotional and context-aware associative learning for robot companions. In: 2015 24th IEEE International Symposium on robot and human interactive communication (RO-MAN), pp 31–36. IEEE
Riesenhuber M, Poggio T (1999) Hierarchical models of object recognition in cortex. Nat Neurosci 2(11):1019–1025
Rizzi C, Johnson CG, Fabris F, Vargas PA (2016) A situation-aware fear learning (SAFEL) model for robots. Neurocomputing
Rolls ET (1992) Neurophysiology and functions of the primate AMYG. In: The AMYG: neurobiologycal aspects of emotion, memory and mental dysfunction
Rouhani H, Jalili M, Araabi BN, Eppler W, Lucas C (2007) Brain emotional learning based intelligent controller applied to neurofuzzy model of micro-heat exchanger. Expert Syst Appl 32(3):911–918
Saabni R (2016) Recognizing handwritten single digits and digit strings using deep architecture of neural networks. In: International conference on artificial intelligence and pattern recognition (AIPR), pp 1–6. IEEE
Sadeghieh A, Sazgar H, Goodarzi K, Lucas C (2012) Identification and real-time position control of a servo-hydraulic rotary actuator by means of a neurobiologically motivated algorithm. ISA Trans 51(1):208–219
Sharma MK, Kumar A (2015) Performance comparison of brain emotional learning-based intelligent controller (BELBIC) and PI controller for continually stirred tank heater (CSTH). In: Computational Advancement in Communication Circuits and Systems, pp 293–301. Springer India
Sierra A, Macias JA, Corbacho F (2001) Evolution of functional link networks. IEEE Trans Evol Comput 5(1):54–65
Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysis. In: ICDAR Vol. 3, pp 958–962
Tomczak JM, Gonczarek A (2016) Learning invariant features using subspace restricted Boltzmann machine. Neural Process Lett 1–10
Tsotsos JK, Culhane SM, Wai WYK, Lai Y, Davis N, Nuflo F (1995) Modeling visual attention via selective tuning. Artif Intell 78(1):507–545
Valipour MH, Maleki KN, Ghidary SS (2015) Optimization of emotional learning approach to control systems with unstable equilibrium. In: Lee R (ed) Software engineering, artificial intelligence, networking and parallel/distributed computing. Studies in computational intelligence, vol 569. Springer, Cham, pp 45–56
Vargas-Clara A, Redkar S (2015) Unmanned ground vehicle navigation using brain emotional learning based intelligent controller (BELBIC). Smart Sci 3(1):10–15
von der Malsburg Chr (1973) Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14(2):85–100
Wang X, Peng Q, Fan Y (2016) Detecting susceptibility to breast cancer with SNP-SNP interaction using BPSOHS and emotional neural networks. BioMed Res Int
Wu A, Zeng Z, Chen J (2014) Analysis and design of winner-take-all behavior based on a novel memristive neural network. Neural Comput Appl 24(7–8):1595–1600
Acknowledgements
The author greatly acknowledge support by the Islamic Azad University of Torbat-e-Jam under grant SAL-E-1394.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lotfi, E., Khazaei, O. & Khazaei, F. Competitive Brain Emotional Learning. Neural Process Lett 47, 745–764 (2018). https://doi.org/10.1007/s11063-017-9680-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-017-9680-9