Skip to main content
SpringerLink
Log in

Neural networks and heuristic search

  • Published:
Annals of Mathematics and Artificial Intelligence Aims and scope Submit manuscript

Abstract

This surveys the recent developments of applying neural networks to heuristic search. Special focus is given to three categories of applications: combinatorial optimization, rule-based inference, and modeling assistance. The avenues for research point to additional opportunities and some of the mathematical problems that remain to be solved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. A.L. Barker, D.E. Brown and W.N. Martin, A neural network implementation of a data association algorithm, Technical Report, Institute for Parallel Computation, School of Engineering and Applied Science, University of Virginia, Charlottesville, VA (1988).

    Google Scholar 

  2. E.B. Baum, Towards practical neural computation for combinatorial optimization problems, AIP Conf. Proc. 151 (1986) 53–58.

    Article  Google Scholar 

  3. R.D. Brandt, Y. Wang, A.J. Laub and S.K. Mitra, Alternative networks for solving the Traveling Salesman Problem and the list-matching problem,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July, 1988) pp. 333–340.

    Article  Google Scholar 

  4. J. Bruck and J.W. Goodman, On the power of neural networks for solving hard problems, Technical Report, Department of Electrical Engineering, Stanford University, Palo Alto, CA, presented at theIEEE Neural Information Processing Systems Conf., Denver, CO (November 1987).

    Google Scholar 

  5. D.J. Burr, An improved elastic net method for the Traveling Salesman Problem,IEEE Int. Conf. on Neural Networks, vol. 1, San Diego, CA (July 1988) pp. 69–76.

    Article  Google Scholar 

  6. S.C. Chan, L.S. Hsu, S. Brody and H.H. Teh, Neural-logic networks, Technical Report, Department of Information Systems and Computer Science, National University of Singapore, Singapore (1988).

    Google Scholar 

  7. S. Chen, X. Xu, W.T. Tsai and N.K. Huang, A case study of solving optimization problems using neural network, Technical Report, Department of Computer Science, University of Minnesota, Minneapolis, MN (1988).

    Google Scholar 

  8. L.A. Cox, Jr., Distributed belief-propagation in probabilistic causal models, presented atMathematics Clinic: Neural Networks and Artificial Intelligence, University of Colorado at Denver, Denver, CO (September, 1988).

    Google Scholar 

  9. J. Daboul and H.I. Stern, A generalization of the Hopfield-Tank neural network model, Technical Report, Ben Gurion University of the Negev, Beer Sheva, Israel (1989).

    Google Scholar 

  10. J.W. Denton and G.R. Madey, Impact of neurocomputing on operations research,Proc. 2nd CSTS Symp. on Impacts of Recent Computer Advances on Operations Research, 1988 (American Elsevier, to appear).

  11. Y-P.S. Foo and Y. Takefuji, Stochastic neural networks for solving job-shop scheduling, Part 1: Problem representation and Part 2: Architecture and simulations,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 275–290.

    Google Scholar 

  12. Y-P.S. Foo and Y. Takefuji, Integer linear programming neural networks for job-shop scheduling,IEEE Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 341–348.

    Google Scholar 

  13. Y-P.S. Foo, Y. Takefuji and H. Szu, Binary neurons with analog communication links for solving large-scale optimization problems, Neural Networks 1 (Abstract only in Suppl. 1) (1988) 437.

    Article  Google Scholar 

  14. S.I. Gallant, Connectionist expert systems, Commun. ACM 31: 2 (1988) 152–169.

    Article  Google Scholar 

  15. S.I. Gallant and D. Smith, Random cells: An idea whose time has come and gone...and come again?,IEEE 1st Int. Conf. on Neural Networks, San Diego, CA (June 1987) pp. 671–678.

  16. H. Geffner and J. Pearl, On the probabilistic semantics of connectionist networks,IEEE 1st Int. Conf. on Neural Networks, San Diego, CA (June 1987) pp. 187–195.

  17. S. Geman and D. Geman, Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images, IEEE Trans. Pattern Analysis and Machine Intelligence PAMI-6 (1984) 721–741.

    Article  Google Scholar 

  18. S. Geman and C.-R. Hwang, Diffusions for global optimization, Technical Report, Brown University, Providence, RI (1985).

    Google Scholar 

  19. F. Glover, Future paths for integer programming and links to artificial intelligence, Computers and Oper. Res. 13: 5 (1986) 533–549.

    Article  MathSciNet  MATH  Google Scholar 

  20. F. Glover and H.J. Greenberg, New approaches for heuristic search: A bilateral linkage with artificial intelligence, Europ. J. Oper. Res. (1988) 1–12.

  21. R.M. Golden, Probabilistic characterizations of neural model computations, Technical Report, University of Pittsburgh, Pittsburgh, Penn. (1987).

    Google Scholar 

  22. M. Goldstein, N. Toomarian and J. Barhen, A comparison study of optimization methods for the bipartite matching problem (BMP),IEEE Int. Conf. on neural Networks, vol. 2, San Diego, CA (July 1988) pp. 267–273.

    Article  Google Scholar 

  23. H.J. Greenberg, Neural networks for an intelligent mathematical programming system,Proc. 2nd CSTS Symp. on Impacts of Recent Computer Advances on Operations Research, 1988 (American Elsevier, to appear).

  24. H.J. Greenberg, Validation of decision support systems, in:Mathematical Models for Decision Support, ed. G. Mitra (Springer, 1988) pp. 641–657.

  25. S. Grossberg, On learning information, lateral inhibition, and transmitters, Math. Biosci. 4 (1969) 225–310.

    Google Scholar 

  26. S.U. Hegde, J.L. Sweet and W.B. Levy, Determination of parameters in a Hopfield/Tank computational network,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 291–298.

    Google Scholar 

  27. C.W. Holsapple and A.B. Whinston,Manager's Guide to Expert Systems Using Guru (Dow Jones-Irwin, 1986).

  28. J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. National Academy of Science USA vol. 79 (April 1982) pp. 2554–2558.

    Article  MathSciNet  Google Scholar 

  29. J.J. Hopfield and D.W. Tank, “Neural” computation of decisions in optimization problems, Biological Cybernetics 52 (1985) 141–152.

    MathSciNet  MATH  Google Scholar 

  30. G.J. Hueter, Solution of the Travelling Salesman Problem with an adaptive ring,IEEE Int. Conf. on Neural Networks, vol. 1, San Diego, CA (July 1988) pp. 85–92.

    Article  Google Scholar 

  31. S. Kirkpatrick, C.D. Gelatt, Jr. and M.P. Vecchi, Optimization by simulated annealing, Science 220: 4598 (1983) pp. 671–680.

    Article  MathSciNet  MATH  Google Scholar 

  32. B.W. Lee and B.J. Sheu, An investigation on local minima of Hopfield networks for optimization circuits,IEEE Int. Conf. on Neural Networks, vol. 1, San Diego, CA (July 1988) pp. 45–51.

    Article  Google Scholar 

  33. W.S. McCulloch and W. Pitts, A logical calculus of the ideas immanent in nervous activity, Bull. Math. Biophys. 5 (1943) 115–133.

    Article  MathSciNet  MATH  Google Scholar 

  34. J.L. McClelland, The programmable blackboard model of reading, In:Parallel Distributed Processing, eds. D.E. Rumelhart and J.L. McClelland (MIT Press, 1986) vol. 2, pp. 122–169.

  35. J. Pearl,Heuristics: Intelligent Search Strategies for Computer Problem Solving (Addison-Wesley, 1984).

  36. J. Pearl, Fusion, propagation, and structuring in belief networks, Artificial Intelligence 29 (1986) 241–288.

    Article  MathSciNet  MATH  Google Scholar 

  37. J. Pearl, Distributed revision of composite beliefs, Artificial Intelligence 33 (1987) 173–215.

    Article  MathSciNet  MATH  Google Scholar 

  38. P.G. Politakis,Empirical Analysis for Expert Systems (Pitman, 1985).

  39. J. Ramanujam and P. Sadayappan, Optimization by neural networks,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 325–332.

    Article  Google Scholar 

  40. R. Rosenblatt,Principles of Neurodynamics (Spartan Books, 1961).

  41. D.E. Rumelhart, P. Smolensky, J.L. McClelland and G.E. Hinton, Schemata and sequential thought processes in PDP models, in:Parallel Distributed Processing, eds. D.E. Rumelhart and J.L. McClelland (MIT Press, 1986) vol. 2, pp. 7–57.

  42. T. Samad, Towards connectionist rule-based systems,IEEE 2nd Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988).

  43. K. Sheff and H. Szu, Optical optimization processor based on binary neurons and analog interconnects, Neural Networks 1 (Abstract only in Suppl. 1) (1988) 408.

    Article  Google Scholar 

  44. J. Sowa,Conceptual Information Processing in Man and Machine (Addison-Wesley, 1984).

  45. H. Szu, Fast TSP algorithm based on binary neuron output and analog neuron input using the zero-diagonal interconnect matrix and necessary and sufficient constraints of the permutation matrix,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 259–266.

    Article  Google Scholar 

  46. D.W. Tank and J.J. Hopfield, Simple optimization networks: An A/D converter and a linear programming circuit, IEEE Trans. Circuit And Systems CAS-33 (1986) 533–541.

    Article  Google Scholar 

  47. D.E. Van den Bout and T.K. Miller, A Traveling Salesman objective function that works,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 299–303.

    Article  Google Scholar 

  48. E. Wacholder, J. Han and R.C. Mann, An extension of the Hopfield-Tank model for solution of the multiple Traveling Salesmen Problem,IEEE Int. Conf. on Neural Networks, vol. 2, San Diego, CA (July 1988) pp. 305–323.

    Article  Google Scholar 

  49. B. Widrow and M.E. Hoff, Jr., Adaptive switching circuits, Institute of Radio Engineers Western Electronic Show and Convention, Convention Record, part 4 (1960) pp. 96–104.

  50. G.V. Wilson and G.S. Pawley, On the stability of the Travelling Salesman Problem algorithm of Hopfield and Tank, Biological Cybernetics 58 (1988) 63–70.

    Article  MathSciNet  MATH  Google Scholar 

  51. X. Xu, W.T. Tsai and N.K. Huang, A generalized neural network model, Neural Networks 1 (Abstract only in Suppl. 1) (1988) 150.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Mathematics Department, University of Colorado at Denver, 80204, Denver, CO, USA

    Harvey J. Greenberg

Authors
  1. Harvey J. Greenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Greenberg, H.J. Neural networks and heuristic search. Ann Math Artif Intell 1, 75–95 (1990). https://doi.org/10.1007/BF01531071

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01531071

Keywords

Search

Navigation