Loading [a11y]/accessibility-menu.js
On the relaxed synchronization for massively parallel numerical algorithms | IEEE Conference Publication | IEEE Xplore

On the relaxed synchronization for massively parallel numerical algorithms


Abstract:

This paper presents a novel relaxed synchronization strategy for generic numerical algorithms executed in distributed and parallel computing systems. Large problems are e...Show More

Abstract:

This paper presents a novel relaxed synchronization strategy for generic numerical algorithms executed in distributed and parallel computing systems. Large problems are efficiently solved if they can be parallelized. However, as the number of processing elements increases, the communication, necessary to synchronize intermediate computation across processing elements, increases and soon becomes a serious bottleneck. This is a critical concern if future multicore machines are to be useful for scientific computing. In this paper, we analyze the convergence of numerical algorithms in the dynamical system framework and introduce a relaxed synchronization technique. This reduces the synchronization bottleneck through periodic communications across processing elements. Instead of synchronizing after every iterations, the proposed framework synchronizes at a certain period. We provide the condition to determine an appropriate synchronization period. It is shown that with this relaxation, the numerical algorithm converges faster to the same fixed-point value than the conventional implementation. The validity and efficiency of the proposed algorithm is verified by numerical example.
Date of Conference: 06-08 July 2016
Date Added to IEEE Xplore: 01 August 2016
ISBN Information:
Electronic ISSN: 2378-5861
Conference Location: Boston, MA, USA

References

References is not available for this document.