Skip to main content
SpringerLink
Log in

The resource running time manager for integrated environment

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Latest scientific application and simulation are requiring powerful computing resources. To get the sufficient resources, more and more computer experts are constructing high-end supercomputer, cluster computing or cloud computing. Although most corporations are starting to use high performance computing by organizing cluster, they rarely add some extra resources dynamically when computing power is not sufficient. In addition, they are also expensive to use insufficient resources as cloud computing resources. To overcome resource limitations when using cloud computing to conduct large computations, we exploit underutilized personal desktops by organizing a heterogeneous cluster environment. An open-source based scheduler, Son of Grid Engine (SGE) is provided in the integrated environment to manage or control the extra computing resources. Two kinds of groups are classified according to the individuals degree of utilization: a full-time group that provides resources at any time, and a custom-time group that provides resources only at designated times. We developed a resource manager that can turn on/off and schedule the SGE execution daemon; this manager performs as the core engine. The resource running time manager efficiently allocates and controls the members of affiliated computing resources.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Topcuoglu, H., Hariri, S., Min-You, W.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13, 260–274 (2002)

    Article  Google Scholar 

  2. Yu, J., Buyya, R.: A taxonomy of scientific workflow systems for grid computing. SIGMOD Rec. 34(3), 44–49 (2005)

    Article  Google Scholar 

  3. Stephen, J.E., Robert, D.A.: The vital importance of high-performance computing to U.S. competitiveness. Information Technology & Innovation Foundation, Washington, DC (2016)

  4. Van, H.N., Tran, F.D., Menaud, J.-M.: SLA-aware virtual resource management for cloud infrastructures. In: CIT ’09. Ninth IEEE International Conference on Computer and Information Technology, vol. 1, pp. 357–362 (2009)

  5. Mahajan, K., Makroo, A., Dahiya, D.: Round robin with server affinity: a VM load balancing algorithm for cloud based infrastructure. J. Inf. Process. Syst. 9(3), 379–394 (2013)

    Article  Google Scholar 

  6. Elastic Compute Cloud (EC2). http://aws.amazon.com/ec2 (2017)

  7. Buschettu, A., Sanna, D., Concas, G., Eros, F.: A platform based on Kanban to build taxonomies and folksonomies for DMS and CSS. J. Converg. 6(1), 1–8 (2015)

    Google Scholar 

  8. Keegan, N., Ji, S.-Y., Chaudhary, A., Concolato, C., Yu, B., Jeong, D.H.: A survey of cloud-based network intrusion detection analysis. Hum. Centric Comput. Inf. Sci. 6(19), 9 (2016)

    Google Scholar 

  9. Zhu, W., Lee, C.: A security protection framework for cloud computing. J. Inf. Process. Syst. 12(3), 538–547 (2016)

    Google Scholar 

  10. Son of Grid Engine. https://arc.liv.ac.uk/trac/SGE (2017)

  11. Oracle Grid Engine. http://www.oracle.com (2017)

  12. Univa Grid Engine. http://www.univa.com/products (2017)

  13. Windows Subsystem for Linux. https://msdn.microsoft.com/en-us/commandline/w-sl/install_guide (2017)

  14. PHP. http://php.net (2017)

  15. MySQL. https://www.mysql.com (2017)

  16. Qhost. http://gridscheduler.sourceforge.net/htmlman/htmlman1/qhost.html (2017)

  17. Qstat. http://gridscheduler.sourceforge.net/htmlman/htmlman1/qstat.html (2017)

  18. mysql-connector-python. https://pypi.python.org/pypi/mysql-connector-python/2.0.4 (2017)

  19. python-daemon. https://pypi.python.org/pypi/python-daemon (2017)

  20. python-lockfile. https://pypi.python.org/pypi/lockfile/0.9.1 (2017)

Download references

Acknowledgements

This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00350, Shape Pattern Modeling Method based on 3D CAD and Integration Analysis Platform Development for Manufacturing Engineering) and the Korea Institute of Science and Technology Information (KISTI).

Author information

Authors and Affiliations

  1. Department of Supercomputing M&S Technology Development, Korea Institute of Science and Technology Information (KISTI), Daejeon, Korea

    Daeyong Jung, Heeseok Jeong & Myungil Kim

  2. Supercomputing Modeling & Simulation Center, Korea Institute of Science and Technology Information (KISTI), Daejeon, Korea

    Jaesung Kim

  3. Department of Computer Engineering, Seokyeong University, Seoul, Korea

    Daewon Lee

Authors
  1. Daeyong Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heeseok Jeong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jaesung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daewon Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Myungil Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Myungil Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jung, D., Jeong, H., Kim, J. et al. The resource running time manager for integrated environment. Cluster Comput 22 (Suppl 1), 1777–1786 (2019). https://doi.org/10.1007/s10586-017-1520-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-017-1520-1

Keywords

Search

Navigation