Skip to main content

Accelerating Processing of Scale-Free Graphs on Massively-Parallel Architectures

  • Conference paper
  • First Online:
Algorithms and Architectures for Parallel Processing (ICA3PP 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10393))

  • 2326 Accesses

Abstract

Processing of big scale-free graphs on parallel architectures with high parallelization opportunities connected with a lot of overheads. Due to skewed degree distribution each thread receives different amount of computational workload. In this paper we present a method devoted to address this challenge by modificating CSR data structure and redistributing work across threads. The method was implemented in breadth-first search and single source shortest path algorithms for GPU architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barabási, A.L., Albert, R.: Emergence of scaling in random networks. Science 286(5439), 509–512 (1999). http://science.sciencemag.org/content/286/5439/509

    Article  MathSciNet  MATH  Google Scholar 

  2. Bullmore, E., Sporns, O.: Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10(3), 186–198 (2009)

    Article  Google Scholar 

  3. Chakrabarti, D., Zhan, Y., Faloutsos, C.: R-mat: a recursive model for graph mining. In: Proceedings of the 2004 SIAM International Conference on Data Mining, pp. 442–446. SIAM (2004)

    Google Scholar 

  4. Chen, C.P., Zhang, C.Y.: Data-intensive applications, challenges, techniques and technologies: a survey on big data. Inf. Sci. 275, 314–347 (2014). http://www.sciencedirect.com/science/article/pii/S0020025514000346

    Article  Google Scholar 

  5. Ediger, D., Jiang, K., Riedy, E.J., Bader, D.A.: Graphct: multithreaded algorithms for massive graph analysis. IEEE Trans. Parallel Distrib. Syst. 24(11), 2220–2229 (2013)

    Article  Google Scholar 

  6. Gregor, D., Lumsdaine, A.: The parallel BGL: a generic library for distributed graph computations

    Google Scholar 

  7. Guimera, R., Mossa, S., Turtschi, A., Amaral, L.N.: The worldwide air transportation network: anomalous centrality, community structure, and cities’ global roles. Proc. Nat. Acad. Sci. 102(22), 7794–7799 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  8. Hagberg, A.A., Schult, D.A., Swart, P.J.: Exploring network structure, dynamics, and function using networkx. In: Varoquaux, G., Vaught, T., Millman, J. (eds.) Proceedings of the 7th Python in Science Conference, Pasadena, CA USA, pp. 11–15 (2008)

    Google Scholar 

  9. Kepner, J., Gilbert, J.: Graph Algorithms in the Language of Linear Algebra. Society for Industrial and Applied Mathematics (2011). http://epubs.siam.org/doi/abs/10.1137/1.9780898719918

  10. Lumsdaine, A., Gregor, D., Hendrickson, B., Berry, J.: Challenges in parallel graph processing. Parallel Process. Lett. 17(01), 5–20 (2007). http://www.worldscientific.com/doi/abs/10.1142/S0129626407002843

    Article  MathSciNet  Google Scholar 

  11. Murphy, R.C., Wheeler, K.B., Barrett, B.W., Ang, J.A.: Introducing the graph 500. Cray Users Group (CUG) (2010)

    Google Scholar 

  12. Otte, E., Rousseau, R.: Social network analysis: a powerful strategy, also for the information sciences. J. Inf. Sci. 28(6), 441–453 (2002). http://dx.doi.org/10.1177/016555150202800601

    Article  Google Scholar 

  13. Valiant, L.G.: A bridging model for parallel computation. Commun. ACM 33(8), 103–111 (1990). http://doi.acm.org/10.1145/79173.79181

    Article  Google Scholar 

  14. Wang, Y., Davidson, A., Pan, Y., Wu, Y., Riffel, A., Owens, J.D.: Gunrock: a high-performance graph processing library on the GPU. In: Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2016, pp. 11:1–11:12. ACM, New York (2016). http://doi.acm.org/10.1145/2851141.2851145

Download references

Acknowledgments

The research was supported by the Ministry of Education and Science of the Russian Federation Agreement no. 02.A03.21.0006.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mikhail Chernoskutov .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Chernoskutov, M. (2017). Accelerating Processing of Scale-Free Graphs on Massively-Parallel Architectures. In: Ibrahim, S., Choo, KK., Yan, Z., Pedrycz, W. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2017. Lecture Notes in Computer Science(), vol 10393. Springer, Cham. https://doi.org/10.1007/978-3-319-65482-9_61

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65482-9_61

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65481-2

  • Online ISBN: 978-3-319-65482-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics