Skip to main content
Log in

Performance of Neural Net Heuristics for Maximum Clique on Diverse Highly Compressible Graphs

  • Published:
Journal of Global Optimization Aims and scope Submit manuscript

Abstract

The problem of finding the size of the largest clique in an undirected graph isNP-hard, even to well-approximate, in the worst case. Simple algorithms,including some we study here, work quite well however, on graphs sampled fromu(n), the uniform distribution on n-vertex graphs. It is felt by many,however, that u(n) does not accurately reflect the nature ofinstances that come up in practice. It is argued that when the actualdistribution of instances is unknown, it is more appropriate to suppose thatinstances come from the Solomonoff–Levin or t universal distributionm(x) instead, which assigns higher weight to instances with shorterdescriptions (i.e., to those that are structured or compressible). We extend atheorem of Li and Vitanyi to show that the average-case performance ratio ofany approximation algorithm on random instances drawn from m(x) hasthe same asymptotic order as its worst-case performance ratio. Becausem(x) is neither computable nor samplable, we employ a realisticanalogue q(x) which lends itself to efficient empirical testing. Weexperimentally evaluate how well certain neural network algorithms for Maximum Clique perform on graphs drawn from q(x), as compared to those drawn from u(n). The experimental results are as follows. All nine algorithms we evaluated performed roughly equally-well on u(n), where as three of them — the simplest ones — performed markedly poorer than the other six on q(x). Our results suggest that q(x), while postulated as a more realistic distribution to test the performance of algorithms than u(n), also discriminates their performance better. Our q(x)sampler can be used to generate compressible instances of any discrete problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. S. Arora, C. Lund, R. Motwani, M. Sudan, and M. Szegedy. Proof verification and hardness of approximation problems. In The Proceedings of the 33rd Annual IEEE Symposium on Foundations of Computer Science, pages 14–23, 1992.

  2. G. Bilbro, R. Mann, T.K. Miller, W.E. Snyder, D.E. Van den Bout, and M. White. Optimization by mean field annealing. In D.S. Touretzky, editor, Advances in Neural Information Processing Systems, volume 1, pages 91–98, San Mateo, 1989. (Denver 1988), Morgan Kaufmann.

  3. R. Carraghan and P.M. Pardalos. An exact algorithm for the maximum clique problem. Operations Research Letters, 9: 375–382, 1990.

    Google Scholar 

  4. U. Feige, S. Goldwasser, L. Lovasz, S. Safra, and M. Szegedy. Approximating clique is almost np-complete. In The Proceedings of the 32nd Annual IEEE Symposium on Foundations of Computer Science, pages 2–12, 1991.

  5. Y. Gurevich and S. Shelah. Nearly linear time. In Proceedings, Logic at Botik, Lecture Notes in Computer Science No. 363, pages 108–118. Springer-Verlag, 1989.

  6. J. Hertz, A. Krogh, and R.G. Palmer. Introduction to the Theory of Neural Computation. Addison-Wesley, 1991.

  7. J.J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, USA, 79, 1982.

  8. J.J. Hopfield. Neurons with graded responses have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences, USA, 81, 1984.

  9. A. Jagota, Approximating maximum clique in a Hopfield-style network. IEEE Transactions on Neural Networks 6(3): 724–735, 1995.

    Google Scholar 

  10. A. Jagota, L. Sanchis, and R. Ganesan. Approximating maximum clique using neural network and related heuristics. In D.S. Johnson and M. Trick, editors, DIMACS Series: Second DIMACS Implementation Challenge 26: 169–204. AMS, 1996.

  11. R.M. Karp. The probabilistic analysis of some combinatorial search algorithms. In J.F. Traub, editor, Algorithms and Complexity: New Directions and Recent Results, pages 1–19. Academic Press, New York, 1976.

    Google Scholar 

  12. M. Li and P.M.B. Vitanyi. Kolmogorov complexity and its applications. In J. vanLeeuwen, editor, Handbook of Theoretical Computer Science, pages 187–254. Elsevier and MIT Press, Amsterdam/New York, 1990.

    Google Scholar 

  13. M. Li and P.M.B. Vitanyi. Average case complexity under the universal distribution equals worst-case complexity. Information Processing Letters 42: 145–149, May 1992.

    Google Scholar 

  14. P. Miltersen. The complexity of malign ensembles. In The Proceedings of the 6th Annual IEEE Conference on Structure in Complexity Theory, pages 164–171, 1991.

  15. E.M. Palmer. Graphical Evolution. Wiley, New York, 1985. Matula’s theorem on page 76.

    Google Scholar 

  16. P.M. Pardalos and J. Xue. The maximum clique problem. Journal of Global Optimization 4: 301–328, 1994.

    Google Scholar 

  17. C. Peterson and B. Söderberg. A new method for mapping optimization problems onto neural networks. International Journal of Neural Systems 1: 3–22, 1989.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jagota, A.K., Regan, K.W. Performance of Neural Net Heuristics for Maximum Clique on Diverse Highly Compressible Graphs. Journal of Global Optimization 10, 439–465 (1997). https://doi.org/10.1023/A:1008263614366

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008263614366

Navigation