Elsevier

Applied Soft Computing

Volume 78, May 2019, Pages 545-568
Applied Soft Computing

A new meta-heuristic optimizer: Pathfinder algorithm

https://doi.org/10.1016/j.asoc.2019.03.012Get rights and content

Highlights

  • A new heuristic algorithm has been proposed.

  • The method is a swarm-based algorithm and different in mathematical model.

  • The proposed method has been tested on some test beds.

  • The proposed method showed a superior performance to find global optima.

  • Also, it has been applied to a real engineering problem and found good results.

Abstract

This paper proposes a new meta-heuristic algorithm called Pathfinder Algorithm (PFA) to solve optimization problems with different structure. This method is inspired by collective movement of animal group and mimics the leadership hierarchy of swarms to find best food area or prey. The proposed method is tested on some optimization problems to show and confirm the performance on test beds. It can be observed on benchmark test functions that PFA is able to converge global optimum and avoid the local optima effectively. Also, PFA is designed for multi-objective problems (MOPFA). The results obtained show that it can approximate to true Pareto optimal solutions. The proposed PFA and MPFA are implemented to some design problems and a multi-objective engineering problem which is time consuming and computationally expensive. The results of final case study verify the superiority of the algorithms proposed in solving challenging real-world problems with unknown search spaces. Furthermore, the method provides very competitive solutions compared to well-known meta-heuristics in literature, such as particle swarm optimization, artificial bee colony, firefly and grey wolf optimizer.

Introduction

The swarm based meta-heuristic optimization algorithms have an important role to optimize the modern engineering problems. This is due to their flexibility, derivation-free mechanisms and local optima avoidance. First of all, it can be mentioned that a heuristic method is simple. Generally, these methods have been based on simple concepts of physical phenomena in nature. Also, this helps the researchers to implement easily meta-heuristic methods to their problems. Furthermore, heuristic methods can be modified for different areas without any major modifications in their structures. This makes them flexible. Moreover, these methods are concerned only with the inputs and outputs of a problem. So that, these methods become derivative-free. Also, in contrast of gradient-based methods, meta-heuristics optimize a problem stochastically, say, the process starts with random initial solution or solutions and they improve these solutions using the random operators during the process. This allows them to be able to avoid local optimums. According to this ability, the meta-heuristics can be implemented to many research areas.

The meta-heuristic methods can be taken into account in three classes: evolutionary based [1], physical-based [2] and swarm intelligence based [3]. Evolutionary based methods start with random population and then evaluate this initial population using one or several operators such as crossover, mutation and selection during the optimization process. In particular, these methods do not care with the information of previous population. The second class is physical-based, which is inspired by physical rules in universe. The search agents in these methods explore the search space in accordance with specific rules of physic. The last class is, generally speaking, based on behaviors of swarm of animals in nature. The methods in this class use the collective movement intelligence of animals. These methods can save the information about optimization problem over the process. On the other side, they have less operators to be adjusted, and thus, they are easy adapted with minor revisions to different areas.

Independently of the differences of algorithms, a general characteristic is that meta-heuristic algorithms divide the optimization process as exploration and exploitation [4]. In the exploration phase, an algorithm performs the searching a possible solution area, where the algorithm needs stochastic operators for the global search and also randomly search abilities. Conversely, in the part of the exploitation, the ability of the algorithm is shaped around local search capability in the promising areas obtained in the exploration [5].

Additionally, a meta-heuristic algorithm is not suitable for solving all optimization problems. Precisely at this time it is worth to mentioning the NFL (No Free Lunch) theorem [6]. This theorem has proved that a meta-heuristic algorithm can give very promising solutions on some optimization problems, but cannot show good performance on all optimization problems. For this reason, the NFL theory causes new meta-heuristic algorithms to be proposed or existing algorithms to be improved. Therefore, in this study, it is the motivation of this study to improve a new meta-heuristic algorithm inspired by the hunting behavior of animals leaded by a leader individual. Despite the use of leadership hierarchy in the literature, there is no a simple model of searching a feeding area or a hunt and directing a swarm by an individual or a pathfinder. For this reason, in this study, a new meta-heuristic algorithm, called Pathfinder (PFA), inspired by the behavior of searching a hunt or feeding area with the leadership of an individual in the animal herds, is presented. In contrast to the algorithms in the literature, in the proposed method there is a leader and the other members follow it. However, the motion of all particles is not orderly, all of them move randomly. Also, the proposed method is completely different in terms of mathematical model and inspiration.

We mentioned in previous section, the most important aspect of heuristic algorithms is that they are inspired by evolutionary, physical systems, swarm intelligence. Evolutionary based methods mimic the evolution concepts. It can be mentioned that the Genetic Algorithm (GA) [7] is well-known method in literature. This algorithm based on theory of Darwin for evolution. GAs have some operators to evaluate its initial population generated randomly which are crossover, mutation and selection. Some of the other famous methods are Differential Evolution (DE) [8] and Evolutionary Programming (EP) [9].

The other branch of algorithms is physics-based. They are based on physical systems. These methods use the physical rules of gravitational force, ray casting inertia force and etc. Some of them are big-bang big-crunch (BBBC) [10], gravitational search algorithm (GSA) [11], charged system search (CSS) [12], central force optimization (CFO) [13], artificial chemical reaction optimization algorithm (ACROA) [14], black hole (BH) [15] algorithm, ray optimization algorithm (RO) [16], small-world optimization algorithm (SWOA) [17], galaxy-based search algorithm (GBSA) [18], and curved space optimization (CSO) [19].

The other class is swarm intelligence-based methods. These methods use the concepts of behavior animals. So that, particle swarm optimization (PSO) [20] and artificial bee colony algorithm (ABC) [21] have been inspired from the behavior of the fish and bird schooling and the food foraging behavior of honey bees in nature, respectively. Another one is ACO [22], inspired by the behavior of ants which is based on finding the shortest path from the nest to the food. Since the development of heuristic algorithms, the interest on this area has been increased. Some recently developed algorithms are firefly algorithm (FA) [23]. The krill herd algorithm (KH) [24]. The bat algorithm (BA) [25], the cuckoo search (CS) [26], artificial algae algorithm (AAA) [27], tree seed algorithm (TSA) [28], the grey wolf optimizer algorithm (GWO), presented in [29], the social spider algorithm (SSA) [30], the moth-flame algorithm (MFA) [31], the salp swarm optimizer (SSO) [32], the whale optimization algorithm (WOA) [33], the dolphin echolocation algorithm (DEA) [34], cat swarm optimizer (CSO) [35] and lion optimization algorithm (LOA) [36].

The paper is organized as follows. Section 2 presents the inspiration and model of Pathfinder algorithm (PFA). Versions of single-objective and multi-objective PFA are introduced in this section. Two metric experiments have been carried out in Section 3 on variety of classical benchmark functions, composite functions and multi-objective functions. In Section 4, several design problems have been handled. Section 5 contains an experiment of challenging problem of multi-objective optimization problem. Finally, Section 6 concludes the study together with some recommends.

Section snippets

Inspiration

The searching, exploiting and hunting abilities of animal swarms have always been a focus of interest for many scientists. All behaviors in a swarm are carried out on the basis of common action of all individuals. Along with that, an individual leads the swarm and this individual directs many acts. Additionally, this individual takes away the herds to targets such as pasture, water and feeding area. The leader may vary depending on the ability to achieve the target [37], [38].

The animals living

Results

The numerical analysis has been included testing of benchmark functions, statistical analysis of multi-objective functions, implementing to design problems and implementing of engineering application. In the next subsection, we discussed these problems respectively. Also, all methods have been coded in MATLAB 2016 software, and PC with Intel i7 CPU, 8 GB RAM and Nvidia GTX950 hardware has been used for all simulations. Note that, all methods have been simulated in same conditions (same

Real engineering applications

In this section, PFA is implemented to several constrained engineering design problems: tension/compression spring [66], welded beam [67], pressure vessel [68] and corrugated beam [69]. The structures and parameters of these design problems are illustrated in Fig. 9. The design problems mentioned have equality and inequality constraints, therefore, PFA must contain a constrained processing method to be capable for optimizing these problems. The fitness independent methods such as PSO and GA

Optimal Placement and Sizing of Renewable Energy Sources (RESs)

In this section, the proposed method has been implemented to optimal placement and sizing problem with four objectives: power loss minimization, voltage deviation optimization, minimization of gas emission and cost minimization. Various algorithms have been applied to optimal placement and sizing of renewable energy sources (RESs) or distributed generations (DGs) in electrical power systems. Optimal placement and sizing of RESs is aimed to optimize the several objective functions such as power

Conclusions

This study proposed a new swarm-based meta-heuristic method to solve optimization problems. The proposed method mimicked the collective movements of swarms with using the hierarchy between leader and other members of swarm. Two separated mathematical formulation were used for position updating of leader and other members. The proposed method simulated in different test beds. The simulations in 2D and 3D space proved that the model presented can be capable for searching around optimal solutions.

References (115)

  • MirjaliliS. et al.

    Salp swarm algorithm: A bio-inspired optimizer for engineering design problems

    Adv. Eng. Softw.

    (2017)
  • MirjaliliS. et al.

    The whale optimization algorithm

    Adv. Eng. Softw.

    (2016)
  • KavehA. et al.

    A new optimization method: dolphin echolocation

    Adv. Eng. Softw.

    (2013)
  • YazdaniM. et al.

    Lion optimization algorithm (LOA): a nature-inspired metaheuristic algorithm

    J. Comput. Des. Eng.

    (2016)
  • CouzinI.D. et al.

    Collective memory and spatial sorting in animal groups

    J. Theoret. Biol.

    (2002)
  • VicsekT. et al.

    Collective motion

    Phys. Rep.

    (2012)
  • FerdinandyB. et al.

    Collective motion of groups of self-propelled particles following interacting leaders

    Physica A

    (2017)
  • AhmedI. et al.

    Collective behavior of self-propelled particles in the presence of moving obstacles

    Mater. Today Proc..

    (2017)
  • CambuiD.S. et al.

    Critical exponents of a self-propelled particles system

    Physica A

    (2016)
  • SochaK. et al.

    Ant colony optimization for continuous domains

    Eur. J. Oper. Res.

    (2008)
  • SadollahA. et al.

    Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems

    Appl. Soft Comput.

    (2013)
  • HeQ. et al.

    An effective co-evolutionary particle swarm optimization for constrained engineering design problems

    Eng. Appl. Artif. Intell.

    (2007)
  • HuangF. et al.

    An effective co-evolutionary differential evolution for constrained optimization

    Appl. Math. Comput.

    (2007)
  • MahdaviM. et al.

    An improved harmony search algorithm for solving optimization problems

    Appl. Math. Comput.

    (2007)
  • DebK.

    An efficient constraint handling method for genetic algorithms

    Comput. Methods Appl. Mech. Engrg.

    (2000)
  • LeeK.S. et al.

    A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice

    Comput. Methods Appl. Mech. Engrg.

    (2005)
  • AskarzadehA.

    A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm

    Comput. Struct.

    (2016)
  • ChengM.-Y. et al.

    Symbiotic organisms search: a new metaheuristic optimization algorithm

    Comput. Struct.

    (2014)
  • AcharyaN. et al.

    An analytical approach for DG allocation in primary distribution network

    Int. J. Electr. Power Energy Syst.

    (2006)
  • GozelT. et al.

    An analytical method for the sizing and siting of distributed generators in radial systems

    Int. J. Electr. Power Syst. Res.

    (2009)
  • OlamaeiJ. et al.

    Application of particle swarm optimization for distribution feeder reconfiguration considering distribution generators

    Appl. Math. Comput.

    (2008)
  • NiknamT. et al.

    A modified honey bee mating optimization algorithm for multiobjective placement of renewable energy resources

    Appl. Energy

    (2011)
  • AliE.S. et al.

    Lion optimization algorithm for optimal location and sizing of renewable distributed generations

    Renew. Energy

    (2017)
  • MohandasN. et al.

    Optimal location and sizing of real power DG units to improve the voltage stability in the distribution system using ABC algorithm united with chaos

    Electr. Power Energy Syst.

    (2015)
  • DeviS. et al.

    Optimal location and sizing determination of distributed generation and DSTATCOM using particle swarm optimization algorithm

    Electr. Power Energy Syst.

    (2014)
  • Mohamed ImranA. et al.

    A novel integration technique for optimal network reconfiguration and distributed generation placement in power distribution networks

    Electr. Power Energy Syst.

    (2014)
  • ZeinalzadehA. et al.

    Optimal multi objective placement and sizing of multiple DGs and shunt capacitor banks simultaneously considering load uncertainty via MOPSO approach

    Electr. Power Energy Syst.

    (2015)
  • KansalS. et al.

    Hybrid approach for optimal placement of multiple DGs of multiple types in distribution networks

    Electr. Power Energy Syst.

    (2016)
  • MuthukumarK. et al.

    Optimal placement and sizing of distributed generators and shunt capacitors for power loss minimization in radial distribution networks using hybrid heuristic search optimization technique

    Electr. Power Energy Syst.

    (2016)
  • NguyenT.T. et al.

    A novel method based on adaptive cuckoo search for optimal network reconfiguration and distributed generation allocation in distribution network

    Electr. Power Energy Syst.

    (2016)
  • KhodabakhshianA. et al.

    Simultaneous placement and sizing of DGs and shunt capacitors in distribution systems by using IMDE algorithm

    Electr. Power Energy Syst.

    (2016)
  • KefayatM. et al.

    A hybrid of ant colony optimization and artificial bee colony algorithm for probabilistic optimal placement and sizing of distributed energy resources

    Energy Convers. Manage.

    (2015)
  • WengG. et al.

    Fault-tolerant location of transient voltage disturbance source for DG integrated smart grid

    Electr. Power Syst. Res.

    (2017)
  • BackT.

    Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms

    (1996)
  • WebsterB. et al.

    A local search optimization algorithm based on natural principles of gravitation

    (2003)
  • BeniG. et al.

    Swarm Intelligence in Cellular Robotic Systems. Robots and Biological Systems: Towards a New Bionics

    (1993)
  • MirjaliliS. et al.

    A new hybrid PSOGSA algorithm for function optimization

  • LinL. et al.

    Auto-tuning strategy for evolutionary algorithms: balancing between exploration and exploitation

    Soft Comput.

    (2009)
  • WolpertD.H. et al.

    No free lunch theorems for optimization

    IEEE Trans. Evol. Comput..

    (1997)
  • GoldbergD.E. et al.

    Genetic algorithms and machine learning

    Mach. Learn.

    (1988)
  • Cited by (259)

    View all citing articles on Scopus
    View full text