Skip to main content
SpringerLink
Log in

Grid-based recording and replay architecture in hybrid remote experiment using distributed streaming network

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

We present a grid-based system that enables researchers in civil engineering to conduct hybrid remote experiments as well as to record and replay these experiments. The system has been designed for Real Time Hybrid Testing Facility in the Korea Construction Engineering Development (KOCED) project and has been implemented based on the Open Service Grid Architecture (OGSA) and the Open System for Earthquake Engineering Simulation (OpenSees) for modeling and computational simulation on structural systems. Users can access the system with a Java client for data visualization and video monitoring through an Internet portal using a web browser. The system runs on a network of distributed NaradaBrokering streaming servers and exploits RFT and GridFTP for reliable file transfer. The main contribution of this paper is that we propose an scalable grid-based recording and replay architecture for remote experiment using distributed streaming network that can scale to support a growing large number of clients simultaneously. We also evaluate the performance of the proposed extensible architecture of distributed servers with mathematical modeling as well as simulations to show how it scales to cope with a growing large number of clients at the same time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Foster I, Kesselman C, Tuecke S (2001) The anatomy of the grid: enabling scalable virtual organizations. Int J High Perform Comput Appl 15:200–222

    Article  Google Scholar 

  2. Zou Y, Zha L, Wang X, Zhou H, Li P (2010) A layered virtual organization architecture for grid. J Supercomput 51(3):333–351

    Article  Google Scholar 

  3. Muthuvelu N, Chai I, Chikkannan E, Buyya R (2011) Batch resizing policies and techniques for fine-grain grid tasks: the nuts and bolts. Int J Inf Process Syst 7(2):299–320

    Google Scholar 

  4. Kesselman C, Foster I, Prudhomme T (2003) Distributed telepresence: the NEESgrid earthquake engineering collaborator. In: The grid 2: blueprint for a new computing infrastructure. Morgan Kaufmann, San Mateo, pp 391–430

    Google Scholar 

  5. Lee J, Jeong T, Yi S (2007) A grid-based remote experiment environment in civil engineering. In: Lecture notes in computer science (International conference on grid and pervasive computing, GPC 2007), vol 4459. Springer, Berlin, pp 263–273

    Google Scholar 

  6. Kim D, Lee J (2008) A grid-based collaboratory for civil engineering experiment. In: Proc of the IEEE international conference on digital ecosystems and technologies, pp 103–108

    Google Scholar 

  7. Molina F, Verzeletti G, Magonette G, Buchet P, Geradin M (1999) Bi-directional pseudodynamic test of a full-size three-storey building. Earthq Eng Struct Dyn 28:1541–1566

    Article  Google Scholar 

  8. Benedetti D, Carydis P, Pezzoli P (1998) Shaking table tests on 24 simple masonry buildings. Earthq Eng Struct Dyn 27:67–90

    Article  Google Scholar 

  9. Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S (2000) The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. J Netw Comput Appl 23:187–200

    Article  Google Scholar 

  10. Gomes L (2009) Current trends in remote laboratories. IEEE Trans Ind Electron 56(12):4744–4756

    Article  Google Scholar 

  11. Hassan H, Dominguez C, Martinez J-M, Perles A, Albaladejo J (2007) Remote laboratory architecture for the validation of industrial control applications. IEEE Trans Ind Electron 54(6):3094–3102

    Article  Google Scholar 

  12. Prieto-Blazquez J, Arnedo-Moreno J, Herrera-Joancomarti J (2008) An integrated structure for a virtual networking laboratory. IEEE Trans Ind Electron 55(6):2334–2342

    Article  Google Scholar 

  13. Hu W, Liu G-P, Zhou H (2013) Web-based 3-D control laboratory for remote real-time experimentation. IEEE Trans Ind Electron 60(10):4673–4682

    Article  Google Scholar 

  14. Garcia-Zubia J, Angulo I, Irurzun J, Orduna P, Ruiz J, Hernandez U, Castro M, Sanscristobal E (2010) Easily integrable platform for the deployment of a remote laboratory for microcontrollers. Int J Online Eng 6(3):26–31

    Google Scholar 

  15. Yazidi A, Henao H, Capolino G-A, Betin F, Filippetti F (2011) A Web-based remote laboratory for monitoring and diagnosis of AC electrical machines. IEEE Trans Ind Electron 58(10):4950–4959

    Article  Google Scholar 

  16. Garcia-Famoso M, Rallo R (2005) Towards the integration of remote laboratories into learning management systems. In: Proc of the IEEE conference on emerging technologies and factory automation, pp 19–22

    Google Scholar 

  17. Olson G, Zimmerman A, Bos N (2008) The upper atmospheric research collaborator and the space physics and aeronomy research collaborator. In: Scientific collaboration on the Internet. The MIT Press, Cambridge, pp 153–170

    Chapter  Google Scholar 

  18. Olson G, Zimmerman A, Bos N (2008) The national virtual observatory. In: Scientific collaboration on the Internet. The MIT Press, Cambridge, pp 135–142

    Chapter  Google Scholar 

  19. Jaroensutasinee K, Jaroensutasinee M, Bainbridge S, Fountain T, Holbrook S, Nekrasov M (2012) CREON—integrating disparate sources of remote coral reef sensor data. In: Proc of the 12th international coral reef symposium, pp 9–13

    Google Scholar 

  20. Tilak S, Arzberger P, Balsiger D, Benson B, Bhalerao R, Chiu K, Fountain T, Hamilton D, Hanson P, Kratz T, Lin F, Meinke T, Winslow L (2007) Conceptual challenges and practical issues in building the global lake ecological observatory network. In: Proc of the international conference on intelligent sensors, sensor networks and information, pp 721–726

    Google Scholar 

  21. Butler R, Servilla M, Gage S, Basney J, Welch V, Baker B, Fleury T, Duda P, Gehrig D, Bletzinger M, Tao J, Freemon D (2007) CyberInfrastructure for the analysis of ecological acoustic sensor data: a use case study in grid deployment. Clust Comput 10(3):301–310

    Google Scholar 

  22. Radic B, Imamagic E, Dobrenic D (2005) Grid data and replica management system. In: Proc of the international conference on information technology interfaces, pp 541–546

    Google Scholar 

  23. Moore R, Rajasekar A, Wan M (2005) Data grids, digital libraries and persistent archives: an integrated approach to publishing, sharing and archiving data. Proc IEEE 93(3):578–588. Special issue on grid computing

    Article  Google Scholar 

  24. Tilak S, Hubbard P, Miller M, Fountain T (2007) The ring buffer network bus (RBNB) DataTurbine streaming data middleware for environmental observing systems. In: Proc of the IEEE international conference on e-science and grid computing, pp 125–133

    Google Scholar 

  25. Allcock W, Bresnahan J, Kettimuthu R, Link M, Dumitrescu C, Raicu I, Foster I (2005) The globus striped GridFTP framework and server. In: Proc of the ACM/IEEE conference on supercomputing, p 54

    Google Scholar 

  26. Bresnahan J, Link M, Khanna G, Imani Z, Kettimuthu R, Foster I (2007) Globus GridFTP: what’s new in 2007. In: Proc of the international conference on networks for grid applications. Article No 19

    Google Scholar 

  27. Madduri R, Hood C, Allcock W (2002) Reliable file transfer in grid environments. In: Proc of the 27th IEEE conference on local computer networks, pp 737–738

    Google Scholar 

  28. Pallickara S, Fox G (2003) NaradaBrokering: a middleware framework and architecture for enabling durable peer-to-peer grids. In: Proc of the ACM/IFIP/USENIX international middleware conference, pp 41–61

    Google Scholar 

  29. Eisenhauer G, Schwan K, Bustamante F (2006) Publish-subscribe for high-performance computing. IEEE Internet Comput 10(1):40–47

    Article  Google Scholar 

  30. Eugster P, Guerraoui R, Sventek J (2000) Distributed asynchronous collections: abstractions for publish/subscribe interaction. In: Proc of the 14th European conference on object-oriented programming, pp 252–276

    Google Scholar 

  31. Nakashima M et al (1990) Integration techniques for substructure pseudodynamic test. In: Proc of the 4th US national conference on earthquake engineering, pp 515–524

    Google Scholar 

  32. Seki K, Iwasaki M, Kawafuku M, Hirai H, Kishida K (2009) Practical controller design of hybrid experimental system for seismic tests. IEEE Trans Ind Electron 56(3):628–634

    Article  Google Scholar 

  33. Nakata N, Yang G, Spencer B Jr (2004) System requirements for Mini-MOST experiment. University of Illinois at Urbana-Champaign MUST-SIM Facility. http://www.neesgrid.org/mini-most/Mini_MOST_requirements_revised3.pdf. Accessed 12 April 2011

  34. Schellenberg A, Mahin S (2006) Integration of hybrid simulation within the general-purpose computational framework OpenSees. In: Proc of the 100th anniversary earthquake conference commemorating the 1906 San Fransisco earthquake

    Google Scholar 

  35. LabVIEW (2013) LabVIEW System Design Software. http://www.ni.com/labview. Accessed March 2013

  36. Brunett S, Czajkowski K, Fitzgerald S, Foster I, Johnson A, Kesselman C, Leigh J, Tuecke S (1998) Application experiences with the globus toolkit. In: Proc of the 7th IEEE international symposium on high performance distributed computing, pp 81–89

    Google Scholar 

  37. Foster I, Kesselman C (1998) Globus: a metacomputing infrastructure toolkit. Int J Supercomput Appl 11(2):115–129

    Article  Google Scholar 

  38. Sotomayor B, Childers L (2005) Globus toolkit 4. Morgan Kaufmann, San Mateo, pp 3–39

    Google Scholar 

  39. Foster I, Kesselman C, Nick J, Tuecke S (2003) The physiology of the grid. In: Grid computing: making the global infrastructure a reality. Wiley, New York, pp 217–249

    Chapter  Google Scholar 

  40. Jang S, Lee J, Lee W (2008) A grid-based architecture for recording and replay of civil-engineering hybrid remote experiment. In: Proc of the international conference on information networking, pp 1–5

    Google Scholar 

  41. NS-2 (2012) The Network Simulator (ns-2). http://www.isi.edu/nsnam/ns. Accessed 12 February 2012

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Hongik University, 72-1, Sangsu, Mapo, Seoul, 121-791, South Korea

    Jang Ho Lee

Authors
  1. Jang Ho Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jang Ho Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, J.H. Grid-based recording and replay architecture in hybrid remote experiment using distributed streaming network. J Supercomput 67, 757–777 (2014). https://doi.org/10.1007/s11227-013-0996-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-013-0996-6

Keywords

Search

Navigation