Skip to main content
Springer Nature Link
Log in

InterGridSim: A Broker-Overlay Based Inter-Grid Simulator

  • Conference paper
  • First Online:
Smart Computing and Communication (SmartCom 2021)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13202))

Included in the following conference series:

  • 1294 Accesses

Abstract

Large scale Grid computing systems are often organized as an inter-Grid architecture, where multiple Grid domains are interconnected through their local broker. In this context, the main challenge is to devise appropriate job scheduling policies that can satisfy goals such as global load balancing together with maintaining the local policies of the different Grids. This paper presents InterGridSim, a simulator for scalable resource discovery and job scheduling technique in broker based interconnected Grid domains. Inter-Grid scheduling decisions are handled jointly by brokers in a broker overlay network. A Broker periodically exchanges its local domain’s resource information with its neighboring brokers. InterGridSim offers several network structures and workload allocation techniques for Tier-1 and Tier-0 networks and large workload capacity. The paper presents sample simulations for throughput, utilisation, and load balancing in a network of 512 brokers and 50k nodes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Joseph, J., Fellenstein, C.: Grid Computing, vol. 1. Prentice Hall Professional, Upper saddle River (2004)

    Google Scholar 

  2. Raman, R., Livny, M., Solomon, M.: Matchmaking: distributed resource management for high throughput computing. In: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC7), Chicago, IL, July 1998 (1998)

    Google Scholar 

  3. Assuno, M.D.D., Buyya, R., Venugopal, S.: Intergrid: a case for internetworking islands of grids. In: Concurrency and Computation: Practice and Experience (CCPE), pp. 997–1024 (2007)

    Google Scholar 

  4. Baake, P., Wichmann, T.: On the economics of internet peering. NETNOMICS 1, 89–105 (1999). https://doi.org/10.1023/A:1011449721395

    Article  Google Scholar 

  5. Chakrabarti, S., Badasyan, N.: Private peering, transit and traffic diversion. NETNOMICS 7(2), 115–124 (2005). https://doi.org/10.1007/s11066-006-9007-x

    Article  Google Scholar 

  6. Huston, G.: Interconnection, peering and settlements-part I. Internet Protocol. 2(1) (1999)

    Google Scholar 

  7. Evers, X., de Jongh, J.F.C.M., Boontje, R., Epema, D.H.J., van Dantzig, R.: Condor flocking: load sharing between pools of workstations. Technical report, Delft, The Netherlands (1993)

    Google Scholar 

  8. Aiftimiei, C., et al.: Design and implementation of the gLite CREAM job management service. Future Gener. Comput. Syst. 26(4), 654–667 (2010)

    Article  Google Scholar 

  9. NorduGrid: Nordic Testbed for Wide Area Computing and Data Handling. http://www.nordugrid.org/

  10. Azab, A., Meling, H.: Stroll: a universal filesystem-based interface for seamless task deployment in grid computing. In: Göschka, K.M., Haridi, S. (eds.) DAIS 2012. LNCS, vol. 7272, pp. 162–176. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-30823-9_14

    Chapter  Google Scholar 

  11. Schopf, J.: Ten actions when superscheduling. In: Global Grid Forum (2001)

    Google Scholar 

  12. Frey, J., Tannenbaum, T., Livny, M., Foster, I., Tuecke, S.: Condor-G: a computation management agent for multi-institutional grids. Clust. Comput. 5(3), 237–246 (2002). https://doi.org/10.1023/A:1015617019423

    Article  Google Scholar 

  13. Buyya, R., Abramson, D., Giddy, J.: Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid. In: Proceedings of HPC ASIA 2000, pp. 283–289 (2000)

    Google Scholar 

  14. Butt, A.R., Zhang, R., Hu, Y.C.: A self-organizing flock of condors. J. Parallel Distrib. Comput. 66(1), 145–161 (2006)

    Article  Google Scholar 

  15. Rowstron, A., Druschel, P.: Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45518-3_18

    Chapter  Google Scholar 

  16. Assuncao, M.: Provisioning techniques and policies for resource sharing between grids. Ph.D. dissertation, The University of Melbourne, Australia (2009)

    Google Scholar 

  17. Azab, A.: Intergridsim: inter-grid simulator based on peersim. https://github.com/abdulrahmanazab/intergridsim

  18. Azab, A., Meling, H.: Slick: a coordinated job allocation technique for inter-grid architectures. In: 7th European Modelling Symposium (EMS) (2013)

    Google Scholar 

  19. Azab, A., Meling, H., Davidrajuh, R.: A fuzzy-logic based coordinated scheduling technique for inter-grid architectures. In: Magoutis, K., Pietzuch, P. (eds.) DAIS 2014. LNCS, vol. 8460, pp. 171–185. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-43352-2_14

    Chapter  Google Scholar 

  20. Azab, A.: Binary matchmaking for inter-grid job scheduling. In: Silhavy, R., Senkerik, R., Oplatkova, Z.K., Silhavy, P., Prokopova, Z. (eds.) Modern Trends and Techniques in Computer Science. AISC, vol. 285, pp. 433–443. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06740-7_36

    Chapter  Google Scholar 

  21. Androutsellis-Theotokis, S., Spinellis, D.: A survey of peer-to-peer content distribution technologies. ACM Comput. Surv. 36(4), 335–371 (2004)

    Article  Google Scholar 

  22. Montresor, A., Jelasity, M.: PeerSim: a scalable P2P simulator. In: Proceedings of the 9th International Conference on Peer-to-Peer (P2P’09), Seattle, WA, Sep 2009, pp. 99–100 (2009)

    Google Scholar 

  23. Condor project. http://www.cs.wisc.edu/condor/

  24. El-Desoky, A.E., Ali, H.A., Azab, A.A.: A pure peer-to-peer desktop grid framework with efficient fault tolerance. In: ICCES’07, Cairo, Egypt, pp. 346–352 (2007)

    Google Scholar 

  25. Allavena, A., Demers, A., Hopcroft, J.E.: Correctness of a gossip based membership protocol. In: Aguilera, M.K., Aspnes, J. (eds.) PODC, ACM, pp. 292–301 (2005)

    Google Scholar 

  26. Neic: Nordic e-infrastructure collaboration. https://neic.no/

  27. Nordic wlcg tier-1 facility. https://neic.no/nt1/

  28. Eosc-nordic project. https://eosc-nordic.eu/

Download references

Author information

Authors and Affiliations

  1. Division of Research Computing, University Center for Information Technology, University of Oslo, Oslo, Norway

    Abdulrahman Azab

Authors
  1. Abdulrahman Azab
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abdulrahman Azab .

Editor information

Editors and Affiliations

  1. Texas A&M University-Commerce, Commerce, TX, USA

    Meikang Qiu

  2. Beijing Institute of Technology, Beijing, Beijing, China

    Keke Gai

  3. Tsinghua University, Beijing, China

    Han Qiu

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Azab, A. (2022). InterGridSim: A Broker-Overlay Based Inter-Grid Simulator. In: Qiu, M., Gai, K., Qiu, H. (eds) Smart Computing and Communication. SmartCom 2021. Lecture Notes in Computer Science, vol 13202. Springer, Cham. https://doi.org/10.1007/978-3-030-97774-0_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-97774-0_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-97773-3

  • Online ISBN: 978-3-030-97774-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics