skip to main content
10.1145/3231053.3231070acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicfndsConference Proceedingsconference-collections
research-article

Training neural networks using Salp Swarm Algorithm for pattern classification

Published: 26 June 2018 Publication History

Abstract

Pattern classification is one of the popular applications of neural networks. However, training the neural networks is the most essential phase. Traditional training algorithms (e.g. Back-propagation algorithm) have some drawbacks such as falling into the local minima and slow convergence rate. Therefore, optimization algorithms are employed to overcome these issues. Salp Swarm Algorithm (SSA) is a recent and novel nature-inspired optimization algorithm that proved a good performance in solving many optimization problems. This paper proposes the use of SSA to optimize the weights coefficients for the neural networks in order to perform pattern classification. The merits of the proposed method are validated using a set of well-known classification problems and compared against rival optimization algorithms. The obtained results show that the proposed method performs better than or on par with other methods in terms of classification accuracy and sum squared errors.

References

[1]
Ahmed A Abusnaina and Rosni Abdullah. 2013. Mussels wandering optimization algorithmn based training of artificial neural networks for pattern classification. Proceedings of the 4th International Conference on Computing and Informatics, ICOCI, 78--85.
[2]
Ahmed A Abusnaina, Rosni Abdullah, and Ali Kattan. 2014. Enhanced MWO training algorithm to improve classification accuracy of artificial neural networks. In Recent advances on soft computing and data mining. Springer, 183--194.
[3]
Ahmed A. Abusnaina, Rosni Abdullah, and Ali Kattan. 2015. The Application of Mussels Wandering Optimization Algorithm for Spiking Neural Networks Training. In 1st International Engineering Conference (IEC2014) On Developments in Civil and Computer Engineering Applications. 197--204.
[4]
Ahmed A Abusnaina, Rosni Abdullah, and Ali Kattan. 2018. Self-Adaptive Mussels Wandering Optimization Algorithm with Application for Artificial Neural Network Training. Journal of Intelligent Systems (2018).
[5]
Ahmed A Abusnaina, Rosni Abdullah, and Ali Kattan. 2018. Supervised Training of Spiking Neural Network by Adapting the E-MWO Algorithm for Pattern Classification. Neural Processing Letters (2018), 1--22.
[6]
Sobhi Ahmed, Majdi Mafarja, Hossam Faris, and Ibrahim Aljarah. 2018. Feature selection using salp swarm algorithm with chaos. In 2018 The Second International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence. ACM.
[7]
Zakaria Noor Aldeen Mahmood Al Nuaimi and Rosni Abdullah. 2017. NEURAL NETWORK TRAINING USING HYBRID PARTICLE-MOVE ARTIFICIAL BEE COLONY ALGORITHM FOR PATTERN CLASSIFICATION. Journal of ICT 16, 2 (2017), 314--334.
[8]
Kevin Bache and Moshe Lichman. 2013. UCI machine learning repository. (2013).
[9]
Christopher Bennett, Rodney A Stewart, and Cara D Beal. 2013. ANN-based residential water end-use demand forecasting model. Expert systems with applications 40, 4 (2013), 1014--1023.
[10]
Christian Blum and Krzysztof Socha. 2005. Training feed-forward neural networks with ant colony optimization: An application to pattern classification. In Hybrid Intelligent Systems, 2005. HIS'05. Fifth International Conference on. IEEE, 6-pp.
[11]
Robert E Dorsey, John D Johnson, and Walter J Mayer. 1994. A genetic algorithm for the training of feedforward neural networks. Advances in artificial intelligence in economics, finance and management 1 (1994), 93--111.
[12]
Hadeel Ibrahim, Mazher Wamidh, Osman Ucan, and Bayat Oguz. 2017. Feature Selection using Salp Swarm Algorithm for Real Biomedical Datasets. IJCSNS International Journal of Computer Science and Network Security (2017).
[13]
Dervis Karaboga, Bahriye Akay, and Celal Ozturk. 2007. Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In International conference on modeling decisions for artificial intelligence. Springer, 318--329.
[14]
Ali Kattan and Rosni Abdullah. 2011. Training of feed-forward neural networks for pattern-classification applications using music inspired algorithm. International Journal of Computer Science and Information Security 9, 11 (2011), 44.
[15]
Ali Kattan and Rosni Abdullah. 2013. Training feed-forward artificial neural networks for pattern-classification using the harmony search algorithm. In The Second International Conference on Digital Enterprise and Information Systems (DEIS2013). The Society of Digital Information and Wireless Communication, 84--97.
[16]
Larry Madin. 1990. Aspects of jet propulsion in salps. Canadian Journal of Zoology (1990).
[17]
Majdi Mafarja, Ibrahim Aljarah, Ali Asghar Heidari, Abdelaziz I. Hammouri, Hossam Faris, Ala M. Al-Zoubi, and Seyedali Mirjalili. 2018. Evolutionary Population Dynamics and Grasshopper Optimization approaches for feature selection problems. Knowledge-Based Systems 145 (2018), 25 -- 45.
[18]
Majdi Mafarja, Derar Eleyan, Salwani Abdullah, and Seyedali Mirjalili. 2017. S-shaped vs. V-shaped transfer functions for ant lion optimization algorithm in feature selection problem. In Proceedings of the International Conference on Future Networks and Distributed Systems. ACM, 14.
[19]
Majdi Mafarja and Seyedali Mirjalili. 2018. Whale optimization approaches for wrapper feature selection. Applied Soft Computing 62 (2018), 441--453.
[20]
Majdi M Mafarja and Seyedali Mirjalili. 2017. Hybrid Whale Optimization Algorithm with simulated annealing for feature selection. Neurocomputing 260 (2017), 302--312.
[21]
Seyedali Mirjalili, Amir Gandomi, Seyedeh Zahra Mirjalili, Shahrzad Saremi, Hossam Faris, and Seyed Mohammad Mirjalili. 2017. Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Advances in Engineering Software (2017).
[22]
Seyedali Mirjalili, Seyed Mohammad Mirjalili, and Andrew Lewis. 2014. Let a biogeography-based optimizer train your multi-layer perceptron. Information Sciences 269 (2014), 188--209.
[23]
Nazri Mohd Nawi, Abdullah Khan, M. Z. Rehman, Tutut Herawan, and Mustafa Mat Deris. 2014. Comparing Performances of Cuckoo Search Based Neural Networks. In Recent Advances on Soft Computing and Data Mining, Tutut Herawan, Rozaida Ghazali, and Mustafa Mat Deris (Eds.). Springer International Publishing, Malaysia, 163--172.
[24]
Wolfram Schiffmann, Merten Joost, and Randolf Werner. 1993. Application of genetic algorithms to the construction of topologies for multilayer perceptrons. In Artificial Neural Nets and Genetic Algorithms. Springer, 675--682.
[25]
Moh'd Khaled Shambour, Ahamad Tajudin Khader, Ahmed A. Abusnaina, and Qusai Shambour. 2014. Modified Tournament Harmony Search for Unconstrained Optimisation Problems. In Recent Advances on Soft Computing and Data Mining, Tutut Herawan, Rozaida Ghazali, and Mustafa Mat Deris (Eds.). Springer International Publishing, Malaysia, 283--292.
[26]
Moh'd Khaled Yousef Shambour, Ahmed A. Abusnaina, and Ahmed I. Alsalibi. 2018. Modified Global Flower Pollination Algorithm and its Application for Optimization Problems. Interdisciplinary Sciences: Computational Life Sciences (2018).
[27]
Danielle NG Silva, Luciano DS Pacifico, and Teresa Bernarda Ludermir. 2011. An evolutionary extreme learning machine based on group search optimization. In Evolutionary computation (CEC), 2011 IEEE congress on. IEEE, 574--580.
[28]
Tejen Su, Jyunwei Jhang, and Chengchih Hou. 2008. A hybrid artificial neural networks and particle swarm optimization for function approximation. International Journal of Innovative Computing, Information and Control 4, 9 (2008), 2363--2374.
[29]
El-Ghazali Talbi. 2009. Metaheuristics: from design to implementation. Vol. 74. John Wiley & Sons.
[30]
K. Wan and V. Alagar. 2016. Characteristics and classification of big data in health care sector. In 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD). 1439--1446.
[31]
Willfried Wienholt. 1993. Minimizing the system error in feedforward neural networks with evolution strategy. In ICANNâĂŹ93. Springer, 490--493.

Cited By

View all
  • (2025)A novel fractional Bessel grey system model optimized by Salp Swarm Algorithm for renewable energy generation forecasting in developed countries of Europe and North AmericaComputational and Applied Mathematics10.1007/s40314-024-03013-w44:2Online publication date: 1-Jan-2025
  • (2024)Swarm-based multi-objective optimization of double-layered microchannel heat sink with hybrid solid-porous ribsNumerical Heat Transfer, Part B: Fundamentals10.1080/10407790.2024.2338919(1-32)Online publication date: 12-Apr-2024
  • (2024)A novel metaheuristic population algorithm for optimising the connection weights of neural networksEvolving Systems10.1007/s12530-024-09641-116:1Online publication date: 5-Dec-2024
  • Show More Cited By

Index Terms

  1. Training neural networks using Salp Swarm Algorithm for pattern classification

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICFNDS '18: Proceedings of the 2nd International Conference on Future Networks and Distributed Systems
    June 2018
    469 pages
    ISBN:9781450364287
    DOI:10.1145/3231053
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. neural networks
    2. optimization
    3. pattern classification
    4. salp swarm algorithm

    Qualifiers

    • Research-article

    Conference

    ICFNDS'18

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)A novel fractional Bessel grey system model optimized by Salp Swarm Algorithm for renewable energy generation forecasting in developed countries of Europe and North AmericaComputational and Applied Mathematics10.1007/s40314-024-03013-w44:2Online publication date: 1-Jan-2025
    • (2024)Swarm-based multi-objective optimization of double-layered microchannel heat sink with hybrid solid-porous ribsNumerical Heat Transfer, Part B: Fundamentals10.1080/10407790.2024.2338919(1-32)Online publication date: 12-Apr-2024
    • (2024)A novel metaheuristic population algorithm for optimising the connection weights of neural networksEvolving Systems10.1007/s12530-024-09641-116:1Online publication date: 5-Dec-2024
    • (2024)Salp Swarm Optimization-Based Approximation of Fractional-Order Systems with Guaranteed StabilityCircuits, Systems, and Signal Processing10.1007/s00034-024-02620-643:6(3440-3460)Online publication date: 29-Feb-2024
    • (2023)A MODIFIED SALP SWARM OPTIMIZATION ALGORITHM BASED ON THE LOAD FREQUENCY CONTROL OF MULTIPLE-SOURCE POWER SYSTEMAURUM Journal of Engineering Systems and Architecture10.53600/ajesa.13211867:1(73-84)Online publication date: 30-Jun-2023
    • (2023)Laplacian Salp Swarm Algorithm for continuous optimizationInternational Journal of System Assurance Engineering and Management10.1007/s13198-023-01935-yOnline publication date: 18-May-2023
    • (2023)An enhanced salp swarm optimizer boosted by local search algorithm for modelling prediction problems in software engineeringArtificial Intelligence Review10.1007/s10462-023-10618-w56:S3(3877-3925)Online publication date: 21-Oct-2023
    • (2023)COOT optimization algorithm on training artificial neural networksKnowledge and Information Systems10.1007/s10115-023-01859-w65:8(3353-3383)Online publication date: 6-Apr-2023
    • (2023)Optimized design of hybrid genetic algorithm with multilayer perceptron to predict patients with diabetesSoft Computing10.1007/s00500-023-07876-927:10(6205-6222)Online publication date: 6-Feb-2023
    • (2023)Optimization of MLP neural network for modeling effects of electric fields on bubble growth in pool boilingHeat and Mass Transfer10.1007/s00231-023-03434-z60:2(329-361)Online publication date: 16-Nov-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media