A novel estimator with moving ants
Introduction
To the best of our knowledge, recursive state estimation of dynamic stochastic systems is of fundamental importance in many other engineering applications besides target tracking. For the linear/Gaussian estimation, the required density is assumed to be Gaussian, and the best solution is usually Kalman filter. However, when such an assumption is extended to the nonlinear/non-Gaussian case, such as bearings-only target tracking problem [1], [2], [3], the problem has no analytic closed-form solution. Fortunately, the extended Kalman filter (EKF), unscented Kalman filter (UKF) and particle filter (PF) [4], [5], [6], [7] are recognized popular and effective means to solve the problem. In EKF, the state distribution is approximated by a Gaussian random variable (GRV), which is then propagated analytically through the first-order linearization of the nonlinear system, and this can introduce large errors in the true posterior mean and covariance of the transformed GRV, which may lead to sub-optimal performance and sometimes divergences of the filter. The UKF address this problem by using a deterministic sampling approach. The state distribution is again approximated by a GRV, but is now represented using a minimal set of carefully chosen sample points. These sample points completely capture the true mean and covariance of the GRV, and when propagated through the true nonlinear system, capture the posterior mean and covariance accurately to the third order for any nonlinearity. Particle filter, also known as Sequential Monte Carlo (SMC) method, has attracted more attentions in recent years over a wide range of applications. In PF, the target state variable distribution is approximated by a weighted set of samples. These samples are propagated and updated once new measurements are available. Using these samples, the target state can be estimated by standard Monte-Carlo integration techniques. To avoid the phenomenon of degeneration, the re-sampling strategy is usually adopted [7].
ACO utilizes artificial ants that cooperate to find good solutions for discrete or continuous optimization problems [8], [9], [10]. These artificial ants mimic the foraging behavior of their biological counterparts in finding the shortest-path to the food source. In generic ACO, such as Ant System in the discrete domain, ants iteratively build solutions and deposit pheromone to the paths they have traveled. Path selection is characterized by a stochastic procedure based usually on two parameters, the pheromone and heuristic values. The pheromone value gives an indication of the number of ants that chose the trail recently, while the heuristic value is a problem-dependent quality measure. When an ant reaches a decision point, it is more likely to choose the trail with the higher pheromone and heuristic values. Once the ant arrives at its destination, the solution corresponding to the ant’s followed path is evaluated and the pheromone value of the path is updated accordingly. Additionally, evaporation causes the pheromone level of all trails to diminish gradually. Hence, trails that are not reinforced gradually lose pheromone and will in turn have a lower probability of being chosen by subsequent ants.
So far, the ACO algorithm is widely utilized in many occasions, such as traveling salesman problem (TSP) [11], job shopping [12], telecommunications networks [13], track initiation problem [14] and so on [15], [16], [17], [18]. However, there are few reports on the ACO algorithm employed into the parameter estimate filed except [19]. In this work, the movement behavior of each ant is considered and utilized to determine the parameter state. Similar to the traditional ACO algorithm, the “pheromone” update process is also defined in the proposed moving ant estimator, which is helpful to guiding all ants moving toward the solution to the problem.
The remainder of this paper is organized as follows: Section 2 presents in detail the moving ant estimator, as well as its improved versions. In Section 3, numerical Monte-Carlo runs are conducted and corresponding results are also analysized. Finally, conclusions and future research directions are given in Section 4.
Section snippets
Dynamic state-space model
Suppose that the states follow the first Markov process and the observations are assumed to be independent given the states. Therefore, for a general nonlinear non-Gaussian system, the model (neglecting control input terms) can be formulated as belowwhere x(t) denotes the state of the system at time t; z(t) is the observation of the interested state; w(t) and v(t) are defined as the process noise and measurement noise with constant covariances Q(t) and R(t),
Algorithm performance and comparison
Several different scenarios are now presented to demonstrate the performance of the proposed moving ant estimator, and the improved versions as well. In the first we provide an example of tracking non-maneuvering target, and the performance comparisons are conducted with PF, PF–EKF, and PF–UKF. In the second scenario we give an example of maneuvering target tracking, and present the comparative simulations with a standard Interacting Multiple Model Particle Filter (IMMPF), IMMPF–EKF, and
Conclusions
A novel recursive parameter estimator, moving ant estimator, is proposed in this paper, which is implemented by regulating movements of a group of ants. In addition, two improved versions of the MAE are also proposed. Numerical simulation results show that the proposed MAE including its two improved versions is capable of tracking not only the non-maneuvering target but also the maneuvering one without any maneuver detection methods and model assumptions. Meanwhile, their performances are
Acknowledgments
This work is supported by National Natural Science Foundation of China (No. 60804068), by Natural Science Fundamental Research Program of Higher Education Colleges in Jiangsu Province (No. 07KJB510001) and by Suzhou Municipal Science Foundation (No. SG0704).
References (21)
On the bias of linear least squares algorithm for passive target localization
Signal Processing
(2004)- et al.
Rao-Blackwellized particle filter for multiple target tracking
Information Fusion
(2007) - et al.
Particle filters for maneuvering target tracking problem
Signal Processing
(2006) - et al.
MAX–MIN ant system
Future Generation Computer Systems
(2000) - et al.
An ant-colony optimization algorithm for minimizing the completion-time variance of jobs in flowshops
International Journal of Production Economics
(2006) - et al.
Ants for track initiation of bearing-only tracking
Simulation Modelling Practice and Theory
(2008) On a novel ACO-estimator and its application to the target motion analysis problem
Knowledge-Based Systems
(2008)Bearings-only target localization using total least squares
Signal Processing
(2005)- et al.
Bearings-only tracking of maneuvering target using a batch-recursive estimator
IEEE Transactions on Aerospace and Electronic Systems
(2001) - S.J. Julier, J.K. Uhlmann, A new extension of the Kalman filter to nonlinear systems, in: Proceedings of Aerosense: The...
Cited by (15)
Enhancing hydrologic data assimilation by evolutionary Particle Filter and Markov Chain Monte Carlo
2018, Advances in Water ResourcesCitation Excerpt :On the other hand, intelligent search and optimization methods categorized as Metaheuristic Algorithms (MAs) in computer science literature have also been used to mitigate the degeneracy problem. This includes Genetic Algorithm (GA) (Higuchi, 1997; Kwok et al., 2005; Park et al., 2009), Evolution Strategy (ES) (Uosaki et al., 2003; Uosaki et al., 2004), Particle Swarm Optimization (PSO) (Wang et al., 2006; Li et al., 2013), Ant Colony Optimization (ACO) (Xu et al., 2009; Park et al., 2010; Zhu et al., 2010), Immune Genetic Algorithm (IGA) (Han et al., 2011), and Inverse Weed Optimization (IWO) (Ahmadi et al., 2012). Among these attempts, GA has received more attention and is known as a more effective method to combine with the PF to prevent the particle degeneracy.
Multi-task ant system for multi-object parameter estimation and its application in cell tracking
2015, Applied Soft Computing JournalCitation Excerpt :Note that the above likelihood score is computed on the histogram template pool T{k+1}, and such a definition encourages more ants to select the mode with a higher mode probability in the following decisions. Although we have addressed the main attributes of our algorithm in previous sections, some contributions, which do not appear in [23,34,35], are summarized and listed below. Candidates.
State estimation of nonlinear dynamic systems using weighted variance-based adaptive particle swarm optimization
2015, Applied Soft Computing JournalA variable neighborhood search particle filter for bearings-only target tracking
2014, Computers and Operations ResearchCitation Excerpt :As can be seen in Fig. 7(b) the SIR filter with 5000 particles is worse in terms of performance compared to VNSPF-50 (L) (L=100, 200). Similar idea was realized in the papers [16,17]. The authors of these papers confirmed that the ant colony and the MIN-MAX ant system based filters were able to track position of the moving object with switching dynamics without the use of the dynamic models.
Ant Colony Estimator: An intelligent particle filter based on ACO <inf>ℝ</inf>
2014, Engineering Applications of Artificial IntelligenceAn ant stochastic decision based particle filter and its convergence
2010, Signal ProcessingCitation Excerpt :In our algorithm, the ant's stochastic behavior will be utilized to develop an easy-to-implementation re-sampling scheme, which could yield a smaller variance on the number of “children” of each particle. Besides this, to the best of our knowledge, the ant's stochastic behavior has been investigated to develop various parameter estimators, such as moving ant estimator in [15] and ACO-estimator in [16]. The former is a recursive estimation technique suitable for real-time target tracking, while the latter is based on the time-consuming batch processing technique.