Abstract
The Kauffman NK model has been used in theoretical biology, physics and business organizations to model complex systems with interacting components. This paper presents new global optima results for the NK model by developing tools for handling dependency in the cases where K grows with N; this generalizes the previous work that focused on the analysis of the (independent) case K=N−1. A dependency graph is defined and studied to handle dependencies among underlying random variables in the NK model. Order statistics (with dependencies) and the expected value of the global optima, E N, K , are bounded using equitable coloring of the dependency graph. These bounds convert the problem of bounding order statistics of dependent random variables into that of independent random variables while incorporating quantitative information about the mutual dependencies between the underlying random variables. An alternative upper bound on E N, K using direct arguments is also proposed. A detailed analysis of E N, K for K close to N (K=N−α and K=β N, α ∈ Z +,β ∈ (0,1)) is given for underlying uniform and normal distributions. Finally, for bounded underlying distributions, the global optima is shown to be concentrated around its mean E N, K .
Similar content being viewed by others
References
Alon, N., Spencer, J.H.: The probabilistic method 2nd edn. John Wiley & Sons, (2000)
Arnold, B.C., Groeneveld, R.A.: Bounds on expectations of linear systematic statistics based on dependent samples. Ann. Statist. 7 (1), 220–223 (1979)
Balakrishna, N., Rao, C.R.: Order Statistics - An Introduction. In: N. Balakrishna, C.R Rao (eds.), Order Statistics - Theory and Methods, Elsevier Science B.V., 1998
David, H.A.: Order statistics 2nd edn. John Wiley & Sons, 1981
Derrida, B.: Random-energy model - An exactly solvable model of disordered systems. Phys. Rev. B, Condensation Matter 24, 2613–2626 (1981)
Durrett, R., Limic, V.: Rigorous results for the NK model. Ann. Probab. 31 (4), 1713–1753 (2003)
Evans, M., Hastings, N., Peacock, J.B.: Statistical Distributions, 3rd edn. Wiley, 2000
Evans, S.N., Steinsaltz, D.: Estimating some features of NK fitness landscapes. Ann. Appl. Prob. 12, 1299–1321 (2002)
Flyvbjerg, H., Lautrup, B.: Evolution in a rugged landscape. Phys. Rev. A, At. Mol. Opt. Phys. 46, 6714–6723 (1992)
Frieze, A.: On random symmetric travelling salesman problems. Math. Oper. Res. 29, 878–890 (2004)
Gao, Y., Culberson, J.: An analysis of phase transition in NK landscapes. J. Artificial Intelligence Res. 17, 309–332 (electronic) (2002)
Gascuel, O., Caraux, G.: Bounds on expectations of order statistics via extremal dependences. Statist. Probab. Lett. 15 (2), 143–148 (1992)
Geard, N., Wiles, J., Halliman, J., Tonkes, B., Skellet, B.: A comparison of neutral landscapes - NK, NKp, NKq. Preprint, University of Queensland, Brisbane, Australia, 2003
Hajnal, A., Szemerédi, E.: Proof of a conjecture of P. Erdös. Combinatorial theory and its applications, II (Proc. Colloq., Balatonfüred, 1969), North-Holland, (1970), pp. 601–623
Hastings, C.: Approximations for digital computers. Princeton University Press, 1955
Hill, S., O'Riordan, C.: Genetic Algorithms, their Operators and the NK Model. Preprint, National University of Ireland, Galway, 2001
Hill, S., O'Riordan, C.: Analysis of the performance of Genetic Algorithms and their Operators using Kauffman's NK Model. Preprint, National University of Ireland, Galway, 2002
Kauffman, S.A.: The Origins of Order. Oxford University Press, Oxford, 1993
Kauffman, S.A., Levin, S.: Towards a general theory of adaptive walks on rugged landscapes. J. Theor. Biol. 128, 11–45 (1987)
Kauffman, S.A., Weinberger, E.D., Perelson, A.S.: Maturation of the immune response via adaptive walks on affinity landscapes. In: A.S Perelson (ed.), Theoretical Immunology, Part I, SFI studies in the Sciences of Complexity, , Addison-Wesley, 1988, pp 349–382
Kaul, H., Jacobson, S.H.: Global optima results for the Kauffman NK model. Mathematical Programming 106, 318–319 (2006)
Levinthal, D.A.: Adaptation on rugged landscapes. Management Sci. 43, 934–950 (1997)
Limic, V., Pemantle, R.: More rigorous results on the Kauffman-Levin model of evolution. Ann. Proba. 32, 2149–2178 (2004)
Macken, C.A., Hagan, P.S., Perelson, A.S.: Evolutionary walks on rugged landscapes. SIAM J. Appl. Math. 51, 799–827 (1991)
Martin, O.C., Monasson, R., Zecchina R.: Statistical mechanics methods and phase transitions in optimization problems. Theoretical Comp. Sci. 265, 3–67 (2001)
McDiarmid, C.: Concentration. In: M. Habib, C. McDiarmid, J. Ramirez-Alfonsin, B. Reed (eds.), Probabilistic Methods for Algorithmic Discrete Mathematics, Springer, New York, 1998, pp 195–248
Patel, J.K., Read, C.B.: Handbook of the normal distribution. 2nd edn. Marcel Dekker, 1996
Pemmaraju, S.: Equitable coloring extends Chernoff-Hoeffding bounds. Proceedings of the 5th International Workshop on Randomization and Approximation Techniques in Computer Science (RANDOM 2001), Berkeley, California, 2001, pp 285–296
Percus, A.G., Martin, O.C.: The stochastic traveling salesman problem. J. Stat. Phys. 94, 739–758 (1999)
Perelson, A.S., Macken, C.A.: Protein evolution on partially correlated landscapes. Proc. National Academy of Science USA 92, 9657–9661 (1995)
Slepian, D.: The one-sided barrier problem for Gaussian noise. Bell System Tech. J. 41, 463–501 (1962)
Solow, D., Burnetas, A., Tsai, M., Greenspan, N.S.: On the expected performance of systems with complex interactions among components. Complex Systems 12, 423–456 (2000)
Solow, D., Vairaktarakis, G., Pideritt, S., Tsai, M.: Managerial insights into the effects of interactions on replacing members of a team. Management Sci. 48, 1060–1073 (2002)
van Zwet, W.R.: Convex transformations of random variables. Mathematical Centre, Amsterdam, 1964
Weinberger, E.D.: A more rigorous derivation of some properties of uncorrelated fitness landscapes. J. Theoretical Biol. 134, 125–129 (1988)
Weinberger, E.D.: Local properties of Kauffman's NK model: A tunably rugged energy landscape. Phys. Rev. A, At. Mol. Opt. Phys. 44, 6399–6413 (1991)
West, D.B.: Introduction to graph theory, 2nd edn. Prentice-Hall, 2000
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kaul, H., Jacobson, S. New global optima results for the Kauffman NK model: handling dependency. Math. Program. 108, 475–494 (2006). https://doi.org/10.1007/s10107-006-0719-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-006-0719-3