Definition
Parallel computing covers a broad range of topics, including algorithms and applications, programming languages, operating systems, and computer architecture. Each of these must be specialized to support parallel computing, and all must be designed and implemented coherently to provide highly efficient parallel computations.
Discussion
Introduction and History
All computations transform data – logically and arithmetically – following a series of algorithms. The broad goals of parallel computing are to improve the speed or functional ease with which this is done. Speed and functionality goals can usually be met, but in many practical cases, difficulties arise that present far more complexity than does traditional sequential computing. The following gives an overview of background issues and the current state of parallel computing.
The long and diverse history of computing is intertwined with parallelism. There will be no attempt here to formulate a rigorous definition of...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Bibliography
Kuck DJ (1978) The structure of computers and computations. Wiley, New York
Randell B (1982) The origins of digital computers. Springer, New York
Hennessy J, Patterson DA (1996) Computer architecture: a quantitative approach, 2nd edn. Morgan Kaufmann, San Francisco
Jia W, Zhou W (2005) Distributed network systems: from concepts to implementations. Springer, New York
Noyce RN (1977) Microelectronics. Sci Am 273(3):63–69
Kennedy K, Allen R (2002) Optimizing compilers for modern architectures. Morgan-Kaufmann, San Francisco
Reinders J (2007) Intel threading building blocks. O’Reilley Media, Sebastapol
Chapman B, Jost G, van der Pas R (2008) Using open MP: portable shared memory parallel programming. O’Reilley Media, Sebastapol
Gropp W, Lusk E, Skjellum A (1999) Using MPI: portable parallel programming with the message-passing interface, 2nd edn. MIT, Cambridge
Kirk D, Hwu W-m (2010) Programming massively parallel processors. Morgan Kaufmann, San Francisco
Akl SG (1989) The design and analysis of parallel algorithms. Prentice Hall, Englewood Cliffs
Grama A (2003) Introduction to parallel computing. Addison Wesley, Reading
Trobec R, Vajtersic M, Zinterhof P (eds) (2009) Parallel computing: numerics, applications, and trends. Springer, New York
Kuck DJ (1996) High performance computing. Oxford University Press, New York
Culler DE, Singh JP, Gupta A (1999) Parallel computer architecture. Morgan Kaufmann, San Francisco
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this entry
Cite this entry
Kuck, D.J. (2011). Parallel Computing. In: Padua, D. (eds) Encyclopedia of Parallel Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09766-4_279
Download citation
DOI: https://doi.org/10.1007/978-0-387-09766-4_279
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09765-7
Online ISBN: 978-0-387-09766-4
eBook Packages: Computer ScienceReference Module Computer Science and Engineering