Abstract
Conventional global optimization algorithms accept a new value that deteriorates the object function at a certain probability to avoid the local optimum. But the computation cost is much higher and the global optimum is not guaranteed. A Neighbourhood Determination (ND) global optimization method was developed in this study. The local optimum neighbourhood boundary is determined and divided by a Wave Front Propagation (WFP) method. Further optimizations are needed only in the irregular-shaped undivided domain. The relationship between the initial solution and the final optimum neighbourhood is used to train the Levenberg-Marquardt neural network. Instead of the costly WFP algorithm, an artificial neural network predicts a new neighbourhood in the remaining domain with dramatically increased efficiency. As the definition domain is completely divided into different subdomains, the actual global optimal solution is found. Numerical examples demonstrate the high efficiency, global searching ability, robustness and stability of this method.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Backus, G.E., Gilbert, F.: The Resolving Power of Gross Earth Data. Geophysical Journal of the Royal Astronomical Society 16, 169–205 (1968)
Liu, P., Ji, C., et al.: An Improved Simulated Annealing-Downhill Simplex Hybrid Global Inverse Algorithm. Chinese Journal of Geophysics 38, 199–205 (1995)
Ji, C., Yao, Z.: The Uniform Design Optimized Method for Geophysics Inversion Problem. Chinese Journal of Geophysics 39, 233–242 (1996)
Ai, Y., Liu, P., Zheng, T.: Adaptive Global Hybrid Inversion. Science in China (series D) 28, 105–110 (1991)
Hibbert, D.B.: A Hybrid Genetic Algorithm for the Estimation of Kinetic Parameters. Chemometrics and Intelligent Laboratory Systems 19, 319–329 (1993)
Chunduru, R., Sen, M.K., et al.: Hybrid Optimization Methods for Geophysical Inversion. Geophysics 62, 1196–1207 (1997)
Macias, C.C., Sen, M.K., et al.: Artificial Neural Networks for Parameter Estimation in Geophysics. Geophysical Prospecting 48, 21–47 (2000)
McCulloch, W.S., Pitts, W.H.: A Logical Calculus of Ideas Imminent in Nervous Activity. Bullet. Math. Biophys. 5, 15–33 (1943)
Hopfield, J., Tank, D.W.: Neural Computation of Decision in Optimization Problems. Biol. Cybernet 52, 41–52 (1985)
Marquardt, D.: An Algorithm for Least-Squares Estimation of Nonlinear Parameters. SIAM Journal Applied Math. 11, 431–441 (1963)
Hagan, M.T., Menhaj, M.: Training Feedforward Networks with the Marquardt Algorithm. IEEE Trans. on Neural Networks 5, 989–993 (1994)
Ampazis, N., Perantonis, S.J.: Two Highly Efficient Second-Order Algorithms for Training Feedforward Networks. IEEE Trans. on Neural Networks 13, 1064–1074 (2002)
Sun, W.T., Shu, J.W., et al.: Dynamic File Allocation in Storage Area Networks with Neural Network Prediction. In: Yin, F.-L., Wang, J., Guo, C. (eds.) ISNN 2004. LNCS, vol. 3174, pp. 719–724. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, W., Shu, J., Zheng, W. (2005). Deterministic Global Optimization with a Neighbourhood Determination Algorithm Based on Neural Networks. In: Wang, J., Liao, X., Yi, Z. (eds) Advances in Neural Networks – ISNN 2005. ISNN 2005. Lecture Notes in Computer Science, vol 3496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11427391_112
Download citation
DOI: https://doi.org/10.1007/11427391_112
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25912-1
Online ISBN: 978-3-540-32065-4
eBook Packages: Computer ScienceComputer Science (R0)