PAGE: A Partition Aware Engine for Parallel Graph Computation | IEEE Journals & Magazine | IEEE Xplore

PAGE: A Partition Aware Engine for Parallel Graph Computation


Abstract:

Graph partition quality affects the overall performance of parallel graph computation systems. The quality of a graph partition is measured by the balance factor and edge...Show More

Abstract:

Graph partition quality affects the overall performance of parallel graph computation systems. The quality of a graph partition is measured by the balance factor and edge cut ratio. A balanced graph partition with small edge cut ratio is generally preferred since it reduces the expensive network communication cost. However, according to an empirical study on Giraph, the performance over well partitioned graph might be even two times worse than simple random partitions. This is because these systems only optimize for the simple partition strategies and cannot efficiently handle the increasing workload of local message processing when a high quality graph partition is used. In this paper, we propose a novel partition aware graph computation engine named PAGE, which equips a new message processor and a dynamic concurrency control model. The new message processor concurrently processes local and remote messages in a unified way. The dynamic model adaptively adjusts the concurrency of the processor based on the online statistics. The experimental evaluation demonstrates the superiority of PAGE over the graph partitions with various qualities.
Published in: IEEE Transactions on Knowledge and Data Engineering ( Volume: 27, Issue: 2, 01 February 2015)
Page(s): 518 - 530
Date of Publication: 29 May 2014

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.