Skip to main content
SpringerLink
Log in

Parallel and multi-wavelength downloading in optical grid networks

  • Published:
Photonic Network Communications Aims and scope Submit manuscript

Abstract

In optical grid networks, data files for job execution are replicated at multiple sites in order to distribute loads and achieve high performance computing. Those replicas are downloaded in parallel in order to reduce downloading time. Furthermore, each replica is downloaded with multiple wavelengths. Although parallel and multi-wavelength downloading reduce downloading time, they raise blocking probability of file downloading. This is because they use a lot of wavelength resources and thus often generate bottleneck links. To resolve this problem, this paper proposes a parallel and multi-wavelength downloading scheme for optical grid networks. The proposed scheme provides replica selection, route selection, and wavelength selection for parallel and multi-wavelength downloading. In the proposed scheme, clients dynamically select combinations of a replica, a route, and a wavelength in such a way that they suppress the generation of bottleneck links. Through simulation experiments, we show that the proposed scheme efficiently improves blocking probability of parallel and multi-wavelength downloading.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Bell, W.H. et al.: Evaluation of an economy-Based file replication strategy for a data grid. In: Proceedings of IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, pp. 661–668 (2003)

  2. Byers, J., Luby, M., Mitzenmacher, M.: Accessing multiple mirror sites in parallel: using Tornado codes to speed up downloads. In: Proceedings of IEEE INFOCOM, New York, NY, pp. 275–283 (1999)

  3. Chang, R., Chang, H., Wang, Y.: A dynamic weighted data replication strategy in data grids. In: Proceedings of the 2008 IEEE/ACS International Conference on Computer Systems and Applications, Doha, Qatar, pp. 414–421 (2008)

  4. Chang R., Guo M., Lin H.: A multiple parallel download scheme with server throughput and client bandwidth considerations for data grids. Future Gener. Comput. Syst. 24(8), 798–805 (2008)

    Article  Google Scholar 

  5. Chervenak A., Foster I., Kesselman C., Salisbury C., Tuecke S.: The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. J. Netw. Comput. Appl. 23(3), 187–200 (2000)

    Article  Google Scholar 

  6. Figueira, S. et al.: DWDM-RAM: enabling grid services with dynamic optical networks. In: Proceedings of IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2004), Chicago, IL, pp. 707–714 (2004)

  7. Gkantsidis, C., Ammar, M., Zegura, E.: On the effect of large-scale deployment of parallel downloading. In: Proceedings of IEEE Workshop on Internet Applications, San Jose, CA, pp. 79–89 (2003)

  8. Hirata K., Kalegele K., Higami Y., Kobayashi S.: Replica selection and downloading based on wavelength availability in λ-grid networks. J. Commun. 5(9), 692–702 (2010)

    Google Scholar 

  9. Hoschek, W., Jaen-Martinez, F. J., Samar, A., Stockinger, H., Stockinger, K.: Data management in an international data grid project. In: Proceedings of the First IEEE/ACM International Workshop on Grid Computing, Bangalore, India, pp. 77–90 (2000)

  10. Jiang, S., Zhang, X.: Efficient distributed disk caching in data grid management. In: Proceedings of IEEE International Conference on Cluster Computing, Williamsburg, VA, pp. 446–451 (2003)

  11. Kaushik N.R., Figueira S.M., Chiappari S.A.: A hybrid algorithm for lightpath assignment. J. Netw. 4(1), 19–29 (2009)

    Google Scholar 

  12. Leenheer, M.D., Develder, C., Stevens, T., Dhoedt, B., Pickavet, M., Demeester, P.: Design and control of optical grid networks. In: Proceedings of Fourth International Conference on Broadband Communications, Networks and Systems (BROADNETS 2007), Raleigh, NC, pp. 107–115 (2007)

  13. AL-Mistarihi H.H.E., Yong C.H.: Response time optimization for replica selection service in data grids. J. Comput. Sci. 4(6), 487–493 (2008)

    Article  Google Scholar 

  14. Otoo, E., Shoshani, A.: Accurate modeling of cache replacement policies in a data grid. In: Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, San Diego, CA, pp. 10–19 (2003)

  15. Park, S., Kim, J., Ko, Y., Yoon, W.: Dynamic data grid replication strategy based on Internet hierarchy. In: Proceedings of Second International Workshop on Grid and Cooperative Computing (GCC 2003), Shanghai, China, pp. 838–846 (2003)

  16. Rahman, R. M., Barker, K., Alhajj, R.: Replica selection in grid environment: a data-mining approach. In: Proceedings of ACM Symposium on Applied Computing, Santa Fe, New Mexico, pp. 695–700 (2005)

  17. Rahman R.M., Alhajj R., Barker K.: Replica selection strategies in data grid. J. Parallel. Distrib. Comput. 68(2), 1561–1574 (2008)

    Article  Google Scholar 

  18. Ranganathan, K., Foster, I.: Identifying dynamic replication strategies for a high-performance data grid. In: Proceedings of the International Grid Computing Workshop, Denver, CO, pp. 75–86 (2001)

  19. Rasool Q., Li J., Oreku G.S., Munir E.U.: Fair-share replication in data grid. Inf. Technol. J. 7(5), 776–782 (2008)

    Article  Google Scholar 

  20. Usui, R., Miyagi, H., Arakawa, Y., Okamoto, S., Yamanaka, N.: A novel distributed data access scheme considering with link resources and metric in lambda grid networks. In: Proceedings of the 14th Asia-Pacific Conference on Communications, Tokyo, Japan, (2008)

  21. Vazhkudai, S., Tuecke, S., Foster, I.: Replica selection in the Globus Data Grid. In: Proceedings of First IEEE/ACM International Symposium on Cluster Computing and The Grid, Brisbane, Australia, pp. 106–113 (2001)

  22. Yang, C., Yang, I., Chen, C., Wang, S.: Implementation of a dynamic adjustment mechanism with efficient replica selection in data grid environments. In: Proceedings of ACM Symposium on Applied Computing, Dijon, France, pp. 797–804 (2006)

  23. Yuan X., Melham R., Gupta R.: Distributed path reservation for multiplexed all-optical networks. IEEE Trans. Comput. 48(12), 1355–1363 (1999)

    Article  Google Scholar 

  24. Zhao, Y., Hu, Y.: GRESS - a grid replica selection service. In: Proceedings of the ISCA 16th International Conference on Parallel and Distributed Computing Systems, Reno, NV, pp. 423–429 (2003)

Download references

Author information

Authors and Affiliations

  1. Graduate School of Science and Engineering, Ehime University, Matsuyama, 790-8577, Japan

    Kouji Hirata

  2. Center for Information Technology, Ehime University, Matsuyama, 790-8577, Japan

    Minoru Kawahara

Authors
  1. Kouji Hirata
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Minoru Kawahara
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kouji Hirata.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hirata, K., Kawahara, M. Parallel and multi-wavelength downloading in optical grid networks. Photon Netw Commun 22, 245–253 (2011). https://doi.org/10.1007/s11107-011-0324-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11107-011-0324-0

Keywords

Search

Navigation