Abstract
Discrete optimization problems (DOPs) arise in various applications such as planning, scheduling, computer aided design, robotics, game playing, and constraint directed reasoning. Often, a DOP is formulated in terms of finding a minimum cost solution path in a graph from an initial node to a goal node. It is solved using graph/tree search methods such as backtracking, branch-and-bound, heuristic search, and dynamic programming. Availability of parallel computers has created substantial interest in exploring the use of parallel processing for solving discrete optimization problems. This article provides an overview of our work on parallel search algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. P. Agrawal, V. K. Janakiram, and Ram Mehrotra. A randomized parallel branch and bound algorithm. In Proceedings of International conference on Parallel Processing, 1988.
S. Arvindam, Vipin Kumar, and V. Nageshwara Rao. Floorplan optimization on multiprocessors. In Proceedings of the 1989 International Conference on Computer Design (ICCD-89), 1989. Also published as MCC Technical Report ACT-OODS-241-89.
S. Arvindam, Vipin Kumar, and V. Nageshwara Rao. Efficient parallel algorithms for search problems: Applications in vlsi cad. In Proceedings of the Frontiers 90 Conference on Massively Parallel Computation, October 1990.
S. Arvindam, Vipin Kumar, V. Nageshwara Rao, and Vineet Singh. Automatic test pattern generation on multiprocessors. Parallel Computing, 17, number 12:1323–1342, December 1991.
D. J. Challou, M. Gini, and V. Kumar. Parallel search algorithms for robot motion planning. Technical Report CS-TR 92-65, University of Minnesota, Minneapolis, MN, 1992. Also appears in the working notes of the 1993 AAAI Spring Symposium on Innovative Applications of Massive Parallelism.
R. Dehne, A. Ferreira, and A. Rau-Chaplin. A massively parallel knowledge-base server using a hypercube multiprocessor. Technical report, Carleton University, SCS-TR-170, April 1990.
M. Evett, James Hendler, Ambujashka Mahanti, and Dana Nau. Pra*: A memory-limited heuristic search procedure for the connection machine. In Proceedings of the third symposium on the Frontiers of Massively Parallel Computation, pages 145–149, 1990.
Chris Ferguson and Richard Korf. Distributed tree search and its application to alpha-beta pruning. In Proceedings of the 1988 National Conference on Artificial Intelligence, August 1988.
R. A. Finkel and J. P. Fishburn. Parallelism in alpha-beta search. Artificial Intelligence, 19:89–106, 1982.
Raphael A. Finkel and Udi Manber. DIB — a distributed implementation of backtracking. ACM Transactions of Programming Languages and Systems, 9 No. 2:235–256, April 1987.
M. Furuichi, K. Taki, and N. Ichiyoshi. A multi-level load balancing scheme for or-parallel exhaustive search programs on the multi-psi. In Proceedings of the 2nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 1990. pp.50–59.
M. Garey and D. S. Johnson. Computers and Intractability. Freeman, San Francisco, 1979.
Ananth Grama, Anshul Gupta, and Vipin Kumar. Isoefficiency function: A scalability metric for parallel algor ithms and architectures. IEEE Parallel and Distributed Technology, Special Issue on Parallel and Distributed Systems: From Theory to Practice, 1993 (To be Published). Also available as Technical Report TR-93-24, Department of Computer Science, University of Minnesota and from anonymous ftp site ftp.cs.umn.edu (128.101.225.7), file users/kumar/isoeff-tutorial.ps.
Ananth Grama, Vipin Kumar, and V. Nageshwara Rao. Experimental evaluation of load balancing techniques for the hypercube. In Proceedings of the Parallel Computing 91 Conference, 1991.
Ananth Y. Grama, V. Kumar, and P. Pardalos. Parallel processing of discrete optimization problems. In Encyclopaedia of Microcomputers. Marcel Dekker Inc., New York, 1992.
Ananth Y. Grama and Vipin Kumar. A survey of parallel search algorithms for discrete optimization problems. Technical report, TR-93-11, Department of Computer Science, University of Minnesota, Minneapolis, 1993. Also available from anonymous ftp site ftp.cs.umn.edu (128.101.225.7), file users/kumar/survey_discrete_opt.ps.
Ellis Horowitz and Sartaj Sahni. Fundamentals of Computer Algorithms. Computer Science Press, Rockville, Maryland, 1978.
M. Imai, Y. Yoshida, and T. Fukumura. A parallel searching scheme for multiprocessor systems and its application to combinatorial problems. In IJCAI, pages 416–418, 1979.
Laveen Kanal and Vipin Kumar. Search in Artificial Intelligence. Springer-Verlag, New York, 1988.
George Karypis and Vipin Kumar. Unstructured Tree Search on SIMD Parallel Computers. Technical Report 92-21, Computer Science Department, University of Minnesota, 1992. A short version of this paper appears in the Proceedings of Supercomputing 1992 Conference, November 1992.
V. Kumar, P. S. Gopalkrishnan, and L. Kanal (editors). Parallel Algorithms for Machine Intelligence and Vision. Springer Verlag, New York, 1990.
V. Kumar and L. Kanal. Parallel branch-and-bound formulations for and/or tree search. IEEE Transactions Pattern Analysis and Machine Intelligence, PAMI-6:768–778, 1984.
Vipin Kumar. Depth-first search. In Stuart C. Shapiro, editor, Encyclopaedia of Artificial Intelligence: Vol 2, pages 1004–1005. John Wiley and Sons, Inc., New York, 1987.
Vipin Kumar, Ananth Grama, and V. Nageshwara Rao. Scalable load balancing techniques for parallel computers. Technical report, Technical Report 91-55, Computer Science Department, University of Minnesota, 1991. To appear in Jornal of Distributed and Parallel Computing, 1993.
Vipin Kumar, Ananth Y. Grama, Anshul Gupta, and George Karypis. Introduction to Parallel Computing: Algorithm Design and Analysis. Benjamin/Cummings, 1994.
Vipin Kumar and Anshul Gupta. Analyzing the scalability of parallel algorithms and architectures: A survey. In Proceedings of the 1991 International Conference on Supercomputing, June 1991. also appear as an invited paper in the Proceedings of 29th Annual Allerton Conference on Communication, Control and Computing, Urbana, IL, October 1991.
Vipin Kumar and Laveen Kanal. The cdp: A unifying formulation for heuristic search, dynamic programming, and branch-and-bound. In Laveen Kanal and Vipin Kumar, editors, Search in Artificial Intelligence. Springer-Verlag, New York, 1988.
Vipin Kumar, K. Ramesh, and V. Nageshwara Rao. Parallel best-first search of state-space graphs: A summary of results. In Proceedings of the 1988 National Conference on Artificial Intelligence, pages 122–126, August 1988.
Vipin Kumar and V. N. Rao. Scalable parallel formulations of depth-first search. In Vipin Kumar, P. S. Gopalakrishnan, and Laveen Kanal, editors, Parallel Algorithms for Machine Intelligence and Vision. Springer-Verlag, New York, 1990.
Vipin Kumar and V. Nageshwara Rao. Parallel depth-first search, part II: Analysis. International Journal of Parallel Programming, 16 (6):501–519, 1987.
T. H. Lai and Sartaj Sahni. Anomalies in parallel branch and bound algorithms. Communications of the ACM, pages 594–602, 1984.
E. L. Lawler and D. Woods. Branch-and-bound methods: A survey. Operations Research, 14, 1966.
Guo-Jie Li and Benjamin W. Wah. Coping with anomalies in parallel branch-and-bound algorithms. IEEE Transactions on Computers, C-35, June 1986.
G. Manzini and M. Somalvico. Probabilistic performance analysis of heuristic search using parallel hash tables. In Proceedings of the International Symposium on Artificial Intelligence and Mathematics, Ft. Lauderdale, FL, JAnuary, 1990.
B. Monien and O. Vornberger. Parallel processing of combinatorial search trees. In Proceedings of International Workshop on Parallel Algorithms and Architectures, May 1987.
B. Monien, O. Vornberger, and E. Spekenmeyer. Superlinear speedup for parallel back-tracking. Technical Report 30, University of Paderborn, FRG, 1986.
Judea Pearl. Heuristics-Intelligent Search Strategies for Computer Problem Solving. Addison-Wesley, Reading, MA, 1984.
Curt Powley, Chris Ferguson, and Richard Korf. Parallel heuristic search: Two approaches. In Vipin Kumar, P. S. Gopalakrishnan, and Laveen Kanal, editors, Parallel Algorithms for Machine Intelligence and Vision. Springer-Verlag, New York, 1990.
Abhiram Ranade. Optimal speedup for backtrack search on a butterfly network. In Proceedings of the Third ACM Symposium on Parallel Algorithms and Architectures, 1991.
V. Nageshwara Rao and V. Kumar. Parallel depth-first search, part I: Implementation. International Journal of Parallel Programming, 16 (6):479–499, 1987.
V. Nageshwara Rao and V. Kumar. Concurrent access of priority queues. IEEE Transactions on Computers, C-37 (12), 1988.
V. Nageshwara Rao, V. Kumar, and K. Ramesh. A parallel implementation of iterativedeepening-a*. In Proceedings of the National Conference on Artificial Intelligence (AAAI-87), pages 878–882, 1987.
V. Nageshwara Rao and Vipin Kumar. On the efficiency of parallel backtracking. IEEE Transactions on Parallel and Distributed Systems, 4(4):427–437, April 1993. available as a technical report TR 90-55, Computer Science Department, University of Minnesota.
V. Nageshwara Rao and Vipin Kumar. Superlinear speedup in state-space search. In Proceedings of the 1988 Foundation of Software Technology and Theoretical Computer Science, December 1988. Lecture Notes in Computer Science number 338, Springer Verlag.
V. Nageshwara Rao and Vipin Kumar. On the efficiency of parallel ordered depth-first search. In Proceedings of the 1991 Conference on Distributed Memory and Concurrent Computers, May 1991.
Vikram Saletore and L. V. Kale. Consistent linear speedup to a first solution in parallel state-space search. In Proceedings of the 1990 National Conference on Artificial Intelligence, pages 227–233, August 1990.
Wei Shu and L. V. Kale. A dynamic scheduling strategy for the chare-kernel system. In Proceedings of Supercomputing Conference, pages 389–398, 1989.
Douglas R. Smith. Random trees and the analysis of branch and bound proceedures. Journal of the ACM, 31 No. 1, 1984.
H. Stone and P. Sipala. The average complexity of depth-first search with backtracking and cutoff. IBM Journal of Research and Development, May 1986.
Peter Tinker. Performance and pragmatics of an OR-parallel logic programming system. International Journal of Parallel Programming, 1988.
Benjamin W. Wah, Guo jie Li, and Chee Fen Yu. Multiprocessing of combinatorial search problems. IEEE Computer, pages 93–108, June, 1985.
Benjamin W. Wah, G. J. Li, and C. F. Yu. Multiprocessing of combinatorial search problems. In Vipin Kumar, P. S. Gopalakrishnan, and Laveen Kanal, editors, Parallel Algorithms for Machine Intelligence and Vision. Springer-Verlag, New York, 1990.
Benjamin W. Wah and Y. W. Eva Ma. Manip — a multicomputer architecture for solving combinatorial extremum-search problems. IEEE Transactions on Computers, c-33, May 1984.
Benjamin W. Wah and C. F. Yu. Stochastic modelling of branch-and-bound algorithms with best-first search. IEEE Transactions on Software Engineering, SE-11, September 1985.
Herbert S. Wilf. Algorithms and Complexity. Prentice-Hall, 1986.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1994 Springer-Verlag
About this paper
Cite this paper
Kumar, V., Grama, A.Y. (1994). Parallel search algorithms for discrete optimization problems. In: Henry, J., Yvon, JP. (eds) System Modelling and Optimization. Lecture Notes in Control and Information Sciences, vol 197. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0035459
Download citation
DOI: https://doi.org/10.1007/BFb0035459
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-19893-2
Online ISBN: 978-3-540-39337-5
eBook Packages: Springer Book Archive