Elsevier

Neurocomputing

Volume 148, 19 January 2015, Pages 46-53
Neurocomputing

Pheromone mark ant colony optimization with a hybrid node-based pheromone update strategy

https://doi.org/10.1016/j.neucom.2012.12.084Get rights and content

Abstract

An improved ant colony optimization (ACO) algorithm called pheromone mark ACO abbreviated PM-ACO is proposed for the non-ergodic optimal problems. PM-ACO associates the pheromone to nodes, and has a pheromone trace of scatter points which are referred to as pheromone marks. PM-ACO has a node-based pheromone update strategy, which includes two other rules except a best-so-far tour rule. One is called r-best-node update rule which updates the pheromones of the best-ranked nodes, which are selected by counting the nodes’ passed ants in each iteration. The other one is called relevant-node depositing rule which updates the pheromones of the k-nearest-neighbor (KNN) nodes of a best-ranked node. Experimental results show that PM-ACO has a pheromone integration effect of some neighbor arcs on their central node, and it can result in instability. The improved PM-ACO has a good performance when applied in the shortest path problem.

Introduction

Ant Colony Optimization (ACO) [1] originating from the foraging behavior of the ant colony is a novel evolutionary algorithm. In reality, the ant individuals have simple behaviors when searching food, allocating tasks, cooperative transport, and so on. At the same time, the ant colonies show a emerged higher intelligence so that they can solve complex problems that in some cases far exceed the individual capabilities. ACO is firstly proposed by Dorigo et al. [2], and has some advantages such as highly parallelism, easy to be understood and implemented and so on. After that, some extensions as well as a number of changes were proposed by the scholars around the world. It has been successfully applied in many optimization problems. Hideki Katagiri introduced the incorporation of tabu search and ant colony optimization for solving k-minimum spanning tree problems (k-MST) [3]. To lower the power consumption in wireless sensor networks, Ho et al. [4] utilized the ladder diffusion phase to construct a route map, and then found a optimal path by ACO. Chen et al. [5] suggested a novel information exchange strategy ACO to get a optimal solution for each processor in a massively parallel processors condition. Sundareswaran and Srinivasarao Nayak [6] designed a feedback controller based on ant colony optimization to implement a closed induction motor starting system. Paplinski [7] proposed an Interpolated Ant Colony Optimization (IACO) for continuous domain optimization, and it was applied in linear dynamic systems identification.

Most of published papers concentrated on the hybridization of different algorithms, and there are seldom papers studying the generalized model of pheromone structure. Pheromone structure is a key module of the ACO, and the basic model of ACO solving problems is to build a path on a construction graph G=(V,E) where the nodes set V corresponds to the elements of a solution for the considered problem and arcs set E corresponds to the connections of the elements [8]. It is droved by some artificial ants, which construct tours on the construction graph and deposit pheromones on the arcs, and eventually achieve the goal of getting an optimal path.

Section snippets

Pheromone trail and pheromone mark

When ants construct solutions along the arcs on the construction graph, the pheromone trace left by the ants can be classified into two types. One is built upon the continuous moving of ants, and its trails are formed by the traversed arcs with pheromones. The other is built upon the discrete moving of ants and it associates pheromones to the nodes. They are demonstrated in Fig. 1.

The two pheromone models were firstly discussed by Dorigo et al. [9]. The pheromone models were embedded into a

Simple pheromone mark ACO

Considering a problem on the construction graph, if the pheromones are associated to the nodes, after the ants complete their tour constructions, pheromones are deposited on the traversed nodes. If the problem needs to cover all nodes in an iteration, the best path is a Hamiltonian cycle on the construction graph, and all nodes׳ pheromones can be updated in each iteration, thereby it is impossible to generate a differential pheromone density among different nodes. In this situation, PM-ACO

Pheromones on the r-best nodes

To investigate how the ant individuals communicate each other, Deneubourg et al. [21] designed a double-branch bridge experiment to demonstrate how the ants select branch to pass a bridge, and they considered that the pheromone density on a branch is in direct proportion to the number of ants which pass the branch. The ants then select the branches based on the pheromone density, and the more pheromones there are on a branch, the more possible the ants will select the branch. They proposed an

Improvement 2: the relevant-node depositing rule

In real life, pheromones deposited on a certain spot usually have an influence on the ants in a larger range rather than those in a small range. In the ACO algorithms, compared to it, pheromones deposited on one position (arcs or nodes) will only attract the ants on other positions which are adjacent to the current position. In [22], the authors discussed a diffusible evaporating strategy. It made the pheromones deposited on one arc has an impact on the ants not only the adjacent nodes but also

Experimental results

As a common non-ergodic optimal problem, the shortest path problem (SPP) is a well-investigated problem of graph theory. It searches a shortest path between two nodes on a weighted graph, which has the following features:

  • (1)

    Weighted arcs represent the length of path between two nodes.

  • (2)

    The goal is to search the shortest path between the two specified nodes.

  • (3)

    Need not pass all the nodes.

An example of SPP is given in Fig. 5. There are three path networks. The first network includes 20 nodes and 39 arcs,

Conclusion

The paper proposes a new ant colony optimization algorithm (PM-ACO) for non-ergodic optimal problems. The pheromone is deposited on the nodes but not on the arcs, when the ants construct solutions. This new feature makes the pheromone trace become a series of pheromone points which are called pheromone marks in this paper. To improve the performance of PM-ACO, an extended global pheromone update strategy is studied, and it includes not only a best-so-far tour strategy but also a best-ranked

Xiangyang Deng was born in 1981. He is working for PhD degree in information and communication engineering at Naval Aeronautical and Astronautical University. His research interest is swarm intelligence and complex system simulation.

References (25)

  • M. Dorigo et al.

    The ant colony optimization meta-heuristic

  • A. Colorni, M. Dorigo, V. Maniezzo, et al., Distributed optimization by ant colonies, in: Proceedings of the 1st...
  • Hideki Katagiri et al.

    A hybrid algorithm based on tabu search and ant colony optimization for k-minimum spanning tree problems

    Expert Syst. Appl.

    (2012)
  • Jiun Huei Ho et al.

    A ladder diffusion algorithm using ant colony optimization for wireless sensor networks

    Inf. Sci.

    (2012)
  • L. Chen, H.Y. Sun, S. Wang. A parallel ant colony algorithm on massively parallel processors and its convergence...
  • K. Sundareswaran et al.

    Ant colony based feedback controller design for soft-starter fed induction motor drive

    Appl. Soft Comput.

    (2012)
  • Janusz Paplinski, Continuous ant colony optimization for identification of time delays in the linear plant, in: Lecture...
  • M. Zlochin, M. Dorigo, Model-based Search for Combinatorial Optimization: A Comparative Study, TR/IRIDIA,...
  • C. Blum, M. Dorigo, The hyper-cube framework for ant colony optimization. IEEE Trans. Syst. Man Cybern. Part B 34...
  • M. Dorigo, Optimization, learning and natural algorithms (Ph.D. thesis), Dipartimento di Elettronica, Politecnico di...
  • M. Dorigo et al.

    Ant colony systema cooperative learning approach to the traveling salesman problem

    IEEE Trans. Evol. Comput.

    (1997)
  • J.Q. Geng et al.

    An improved ant colony optimization algorithm for nonlinear resource-leveling problems

    Comput. Math. Appl.

    (2011)
  • Cited by (16)

    • An innovative chain coding mechanism for information processing and compression using a virtual bat-bug agent-based modeling simulation

      2022, Engineering Applications of Artificial Intelligence
      Citation Excerpt :

      One study by Ding et al. (2012) considers adjusting the pheromone level and uses a new operator to enhance the search process in an ant colony algorithm. In similar, Deng et al. (2015) proposed an improvement to the ant colony optimization algorithm via the utilization of some machine learning algorithms. The movements of agents within an agent-based modeling environment can be best imagined as actors moving within a virtual world in different directions, such as up, down, right, and left.

    • A best-path-updating information-guided ant colony optimization algorithm

      2018, Information Sciences
      Citation Excerpt :

      The experimental results show that this ACO algorithm with the novel pheromone update mechanism has better performance in convergence and diversity than do other stochastic search algorithms. Deng et al. [4] proposed an ant colony optimization algorithm (PM-ACO) with a node-based pheromone updating strategy. In addition to the optimal path update rule, the algorithm includes two other update rules.

    • A Hybrid Algorithm Based on Ant Colony and Genetic Algorithm for AUV Path Planning

      2023, Proceedings of the 2nd Conference on Fully Actuated System Theory and Applications, CFASTA 2023
    View all citing articles on Scopus

    Xiangyang Deng was born in 1981. He is working for PhD degree in information and communication engineering at Naval Aeronautical and Astronautical University. His research interest is swarm intelligence and complex system simulation.

    Limin Zhang was born in 1966. He is a professor of Naval Aeronautical and Astronautical University. His research interest is artificial intelligence and complex system modeling.

    Hongwen Lin was born in 1966. He is an associate professor of Naval Aeronautical and Astronautical University. His research interest is radio navigation and signal processing.

    Lan Luo was born in 1983. She got her Master Degree from York University, and is a lecturer of Yantai Vocational College. She is interested in complex system.

    View full text