Abstract
We present a process cooperation algorithm for broadcasting m messages among n processes, m ≥ 1, n ≥ 1, in one-port fully-connected communication systems. In this algorithm, the n processes are organized into \(2^{\lfloor \log n \rfloor}\) one- or two-process units. Messages are broadcast among the units according to a basic communication schedule. Processes in each two-process unit cooperate to carry out the basic schedule in a way that at any step, either process has at most one message that the other has not received. This algorithm completes the broadcast in ⌈logn ⌉ + m − 1 communication steps, which is theoretically optimal. Empirical study shows that it outperforms other widely used algorithms significantly when the data to broadcast is large. Efficient communication schedule construction is a salient feature of this algorithm. Both the basic schedule and the cooperation schedule are constructed in O(logn) bitwise operations on process ranking.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bar-Noy, A., Kipnis, S., Schieber, B.: Optimal multiple message broadcasting in telephone-like communication systems. In: Proceedings of the 6th Symposium on Parallel and Distributed Processing, IEEE, Los Alamitos (1996)
Barnett, M., Gupta, S., Payne, D., Shuler, L., van de Geijn, R., Watts, J.: Interprocessor collective communication library (intercom). In: Proceedings of the Scalable High Performance Computing Conference 1994 (1994)
Beaumont, O., Legrand, A., Marchal, L., Robert, Y.: Pipelining broadcasts on heterogeneous platforms. In: Proceedings of 18th IEEE International Parallel and Distributed Processing Symposium IPDPS 2004, IEEE Computer Society Press, Los Alamitos (2004)
Chan, E., Heimlich, M., Purkayastha, A., Van de Geijn, R.: On optimizing collective communication. In: Proceedings of 2004 IEEE International Conference on Cluster Computing, IEEE Computer Society Press, Los Alamitos (2004)
IBM PE for AIX 5L V4.3: MPI Programming Guide http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp?topic=/com.ibm.cluster.pe.doc/pebooks.html
Johnsson, S., Ho, C.T.: Optimum broadcasting and personalized communication in hypercubes. IEEE Transactions on Computers 38(9), 1249–1268 (1989)
Johnston, F., King-Smith, B.: Ibm pseries high performance switch. Technical report, IBM System and Technology Group (2006)
IBM System p5 UNIX servers, www.ibm.com/systems/p/
Patarasuk, P., Faraj, A., Yuan, X.: Pipelined broadcast on ethernet swtiched clusters. In: Proceedings of the 20th IEEE International Parallel and Distributed Processing Symposium (IPDPS), IEEE Computer Society Press, Los Alamitos (2006)
Sanders, P., Sibeyn, J.F.: A bandwidth latency tradeoff for broadcast and reduction. In: Bode, A., Ludwig, T., Karl, W.C., Wismüller, R. (eds.) Euro-Par 2000. LNCS, vol. 1900, pp. 918–926. Springer, Heidelberg (2000)
Snir, M., Otto, S., Huss-Lederman, S., Walker, D., Dongarra, J.: MPI – The Complete Reference. In: The MPI Core, 2nd edn., vol. 1, MIT Press, Cambridge (1998)
Träff, J., Ripke, A.: Optimal broadcast for fully connected networks. In: Yang, L.T., Rana, O.F., Di Martino, B., Dongarra, J.J. (eds.) HPCC 2005. LNCS, vol. 3726, pp. 45–56. Springer, Heidelberg (2005)
Worringen, J.: Pipelining and overlapping for mpi collective operations. In: 28th Annual IEEE International Conference for Local Computer Networks (LCN 2003), IEEE Computer Society Press, Los Alamitos (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jia, B. (2007). Process Cooperation in Multiple Message Broadcast. In: Cappello, F., Herault, T., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2007. Lecture Notes in Computer Science, vol 4757. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75416-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-75416-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75415-2
Online ISBN: 978-3-540-75416-9
eBook Packages: Computer ScienceComputer Science (R0)