Skip to main content
Log in

Multi-strategy learning and deep harmony memory improvisation for self-organizing neurons

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This study proposes a concept of representation learning by implementing multi-strategy deep learning harmony memory improvisation for selecting the best harmony of self-organizing neurons. Representation learning is a set of methods that allows a machine to be fed with raw data and to automatically discover the representations needed for detection or classification. In our study, the deep multi-strategy learning involves the convolution of the self-organizing neurons with deep harmony memories improvisation in self-organizing and representation of map learning. The convolution of self-organizing neurons and harmony memory optimize the representation neurons’ weights by generating the optimal best matching unit which is represented as fitness function of \(f_1 \left( x \right) \) and \(f_2 \left( x \right) \). While \(f_1 \left[ {g\left( {{f}''_1 \left( x \right) } \right) } \right] \) and \(f_2 \left[ {g\left( {{f}'_2 \left( x \right) } \right) } \right] \) represent the New Harmony fitness function. The best fitness function, \(f_{{ best}} (x)\) is selected based on the \(f_1 \left( x \right) \) and \(f_2 \left( x \right) \) performance which will be later stored in the harmony memory vector. The position vector of a particle is subjected to the Newtonian mechanics constant acceleration during the interval \(\Delta t\). The search space of self-organizing map with Newton-based particle swarm algorithm particles depends on the width area, \(\sigma _\alpha (t)\) of organizing neurons lattice structure. Our proposed methods are experimented on various biomedical datasets. The findings indicate that the proposed methods provide better quantization error for clustering and good classification accuracy with statistical measurement validations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

(Reproduced with permission from Geem 2009b)

Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Alcalá-Fdez J, Fernandez A, Luengo J, Derrac J, García S, Sánchez L, Herrera F (2011) KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J Mult Valued Log Soft Comput 17(2–3):255–287

    Google Scholar 

  • Alia O, Mandava R (2011) The variants of the harmony search algorithm: an overview. Artif Intell Rev 36(1):49–68

    Article  Google Scholar 

  • Amiri B, Hossain L, Mosavi SE (2010) Application of harmony search algorithm on clustering. In World congress on engineering and computer science, vols 1 and 2, pp 460–465

  • Beheshti Z, Shamsuddin SM (2013) A review of population-based meta-heuristic algorithms. Int J Adv Soft Comput Appl 5(1):1–35

    Google Scholar 

  • Beheshti Z, Shamsuddin SMH (2014) CAPSO: centripetal accelerated particle swarm optimization. Inf Sci 258:54–79

    Article  MathSciNet  Google Scholar 

  • Bahesti Z, Shamsuddin SM, Hasan S (2013) MPSO: median oriented particle swarm optimization. Appl Math Comput 219:5817–5836

    MathSciNet  MATH  Google Scholar 

  • Beheshti Z, Shamsuddin SMH, Beheshti E, Yuhaniz SS (2014) Enhancement of artificial neural network learning using centripetal accelerated particle swarm optimization for medical diseases diagnosis. Soft Comput 18(11):2253–2270

    Article  Google Scholar 

  • Brabazon A, O’Neill M (2006) Biologically inspired algorithms for financial modeling. Springer, Berlin

    MATH  Google Scholar 

  • David HW, William GM (1997) No free lunch theorem for optimization. IEEE Trans Evolut Comput 1(1):67–82

    Article  Google Scholar 

  • Geem ZW (2009a) Particle-swarm harmony search for water network design. Eng Optim 41(4):297–311

    Article  Google Scholar 

  • Geem ZW (2009b) Music inspired harmony search algorithm: theory and applications. Springer, New York

    Book  Google Scholar 

  • Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68

    Article  Google Scholar 

  • Hasan S (2010) Enhanced self-organizing map with particle swarm optimization for classification problems. Master thesis, Universiti Teknologi Malaysia

  • Hasan S, Shamsuddin SM (2011) Multistrategy self-organizing map learning for classification problems. Comput Intell Neurosci 2011(121787):11. https://doi.org/10.1155/2011/121787

    Article  Google Scholar 

  • Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, Upper Saddle River

    MATH  Google Scholar 

  • Jiming L, Tsui KC (2006) Toward nature-inspired computing. Commun ACM 49(10):59–64

    Article  Google Scholar 

  • Kattan A, Abdullah R, Salam RA (2010) Harmony search based supervised training of artificial neural networks. In: UKSim-AMSS first international conference on intelligent systems, modelling and simulation, pp 105–110

  • Kennedy J, Eberhart (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks. IEEE Press, Piscataway, NJ, pp 1942–1948

  • Kennedy J, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann, San Francisco

    Google Scholar 

  • Kohonen T (2001) Self-organizing maps. Springer series in information sciences, vol 30, 3rd extended edition. Springer, Berlin

  • Kulluk S, Ozbakir L, Baykasoglu A (2012) Training neural networks with harmony search algorithms for classification problems. Eng Appl Artif Intell 25(1):11–19

    Article  Google Scholar 

  • Lee Anzy, Geem Zong Woo, Suh Kyung-Duck (2016) Determination of optimal weights of an artificial neural networks by using the harmony search algorithm: application to breakwater armor stones. Appl Sci 6(164):1–17

    Google Scholar 

  • Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579

    MathSciNet  MATH  Google Scholar 

  • Mahdavi M, Chehreghani MH, Abolhassani H, Forsati R (2008) Novel meta-heuristic algorithms for clustering web documents. Appl Math Comput 201(1–2):441–451

    MathSciNet  MATH  Google Scholar 

  • Michalski RS (1994) Machine learning: a multistrategy approach. In: Michalski RS, Tecuci G (eds) Inferential learning theory as conceptual basis for multistrategy learning, vol IV. Morgan Kaufmann Publishers, San Mateo

    Google Scholar 

  • Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems, 2nd edn. Addison Wesley, Harlow

    Google Scholar 

  • Omran MGH, Mahdavi M (2008) Global-best harmony search. Appl Math Comput 198(2):643–656

    MathSciNet  MATH  Google Scholar 

  • O’Neill M, Brabazon A (2008) Self-organising swarm (SOSwarm). Soft Comput 12(11):1073–1080

    Article  Google Scholar 

  • Ozcift A, Kaya M, Gulten A, Karabulut M (2009) Swarm optimized organizing map (SWOM): a swarm intelligence based optimization of self-organizing map. Expert Syst Appl 36(7):10640–10648

    Article  Google Scholar 

  • Pan Q-K, SuganthanM PN, Tasgetiren F, Liang JJ (2010) A self-adaptive global best harmony search algorithm for continuous optimization problems. Appl Math Comput 216(3):830–848

    MathSciNet  MATH  Google Scholar 

  • Von der Malsburg C (1973) Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14:85–100

    Article  Google Scholar 

  • Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2003) Gene-clustering using self-organizing maps and particle swarm optimization. IEEE international parallel and distributed processing symposium (IPDPS). IEEE Press

  • Xiao X, Dow ER, Eberhart R, Miled ZB, Oppelt RJ (2004) A hybrid self-organizing maps and particle swarm optimization approach. Concurr Comput Pract Exp 16(9):895–915

    Article  Google Scholar 

  • Yang XS (2009) Music-inspired Harmony search algorithm. In: Geem Z (ed) Harmony search as a metaheuristic algorithm. Springer, Berlin, pp 1–14

    Google Scholar 

  • Yang XS (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley, Hoboken

    Book  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Ministry of Higher Education (MOHE) and Universiti Teknologi Malaysia (UTM) for their support in Research and Development, UTM Big Data Centre and the Soft Computing Research Group (SCRG) for the inspiration in making this study a success. This work is partially supported by the UTM Research University Grant Scheme (17H62) and FRGS (4F786).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shafaatunnur Hasan.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This paper does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hasan, S., Shamsuddin, S.M. Multi-strategy learning and deep harmony memory improvisation for self-organizing neurons. Soft Comput 23, 285–303 (2019). https://doi.org/10.1007/s00500-018-3116-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-018-3116-y

Keywords

Navigation