Abstract
Parallel Tempering (PT), also known as Replica Exchange, is a powerful Markov Chain Monte Carlo sampling approach which aims at reducing the relaxation time in simulations of physical systems. In this paper, we present a novel implementation of PT, so-called decentralized replica exchange PT, using MPI and the Scalable Parallel Random Number Generators (SPRNG) libraries. By adjusting the replica exchange operations in the original PT algorithm, and taking advantage of the characteristics of pseudorandom number generators, this implementation minimizes the overhead caused by interprocessor communication in replica exchange in PT. This enables one to efficiently apply PT to large-scale massively parallel systems. The efficiency of this implementation has been demonstrated in the context of various benchmark energy functions, such as the high-dimensional Rosenbrock function, and a rugged funnel-like function.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Marinari, E., Parisi, G.: Simulated Tempering: a New Monte Carlo Scheme. Europhysics Letters 19, 451–458 (1992)
Geyer, C.J., Thompson, E.A.: Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference. Journal of the American Statistical Association 90, 909–920 (1995)
Falcioni, M., Deem, M.W.: A Biased Monte Carlo Scheme for Zeolite Structure Solution. J. Chem. Phys 110, 1754–1766 (1999)
Schug, A., Herges, T., Verma, A., Wenzel, W.: Investigation of the parallel tempering method for protein folding. J. Phys: Condens. Matter 17, 1641–1650 (2005)
Sikorski, A.: Properties of Star-Branched Polymer Chains – Application of the Replica Exchange Monte Carlo Method. Macromolecules 35(18), 7132–7137 (2002)
Schug, A., Wenzel, W.: Predictive in-silico all atom folding of a four helix protein with a free energy model. J. Am. Chem. Soc. 126, 16737 (2004)
Li, Y., Strauss, C.E.M., Gorin, A.: Parallel Tempering in Rosetta Practice. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004. LNCS, vol. 3072, Springer, Heidelberg (2004)
Mascagni, M., Srinivasan, A.: Algorithm 806: SPRNG: A Scalable Library for Pseudorandom Number Generation. ACM Transactions on Mathematical Software 26, 436–461 (2000)
Bu, L., Straub, J.E.: Simulating Vibrational Energy Flow in Proteins: Relaxation Rate and Mechanism for Heme Cooling in Cytochrome c. J. Phys. Chem. B 107, 12339–12345 (2003)
Li, Y., Protopopescu, V.A., Gorin, A.: Accelerated Simulated Tempering. Physics Letters A 328(4), 274–283 (2004)
Liu, J.S., Liang, F., Wong, W.H.: The Use of Multiple-Try Method and Local Optimization in Metropolis Sampling. Technical Report, Department of Statistics, Stanford University (1998)
Srinivasan, A., Mascagni, M., Ceperley, D.: Testing Parallel Random Number Generators. Parallel Computing 29, 69–94 (2003)
Li, Y., Clark, J., Zhang, X.: Parallel Implementation of the Accelerated Simulated Tempering Method. In: Proceedings of 3rd NPSC Conference, Atlanta (2006)
Li, Y., Protopopescu, V.A., Arnold, N., Zhang, X., Gorin, A.: Hybrid Parallel Tempering/Simulated Annealing Method. submitted to Physical Review E, 2006
Du, Z., Li, S., Li, S., Wu, M., Zhu, J.: Massively parallel simulated annealing embedded with downhill – a SPMD algorithm for cluster computing. In: Proceedings of 1st IEEE Computer Society International Workshop on Cluster Computing (1999)
Drugan, M.M., Thierens, D.: Evolutionary Markov Chain Monte Carlo. Technical Report UU-CS-2003-047, Utrecht university (2003)
Liu, J.S., Sabatti, C.: Simulated Sintering: Markov Chain Monte Carlo with Spaces of Varying Dimensions. In: Bayesian Statistics 6, pp. 389–413. Oxford University Press, Oxford (1999)
Cercueil, A., Francois, O.: Monte Carlo simulation and population-based optimization. In: Congress on Evolutionary Computation, pp. 191–198 (2001)
Laskey, K.B., Myers, J.W.: Population Markov Chain Monte Carlo. Machine Learning, 175–196 (2003)
Mahfoud, S.W., Goldberg, D.E.: Parallel Recombinative Simulated Annealing: a Genetic Algorithm. Parallel Computing, 1–28 (1995)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, Y., Mascagni, M., Gorin, A. (2007). Decentralized Replica Exchange Parallel Tempering: An Efficient Implementation of Parallel Tempering Using MPI and SPRNG. In: Gervasi, O., Gavrilova, M.L. (eds) Computational Science and Its Applications – ICCSA 2007. ICCSA 2007. Lecture Notes in Computer Science, vol 4707. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74484-9_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-74484-9_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74482-5
Online ISBN: 978-3-540-74484-9
eBook Packages: Computer ScienceComputer Science (R0)