Skip to main content

Enabling Interactive Supercomputing at JSC Lessons Learned

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11203))

Abstract

Research and analysis of large amounts of data from scientific simulations, in-situ visualization, and application control are convincing scenarios for interactive supercomputing. The open-source software Jupyter (or JupyterLab) is a tool that has already been used successfully in many scientific disciplines. With its open and flexible web-based design, Jupyter is ideal for combining a wide variety of workflows and programming methods in a single interface. The multi-user capability of Jupyter via JuypterHub excels it for scientific applications at supercomputing centers. It combines the workspace that is local to the user and the corresponding workspace on the HPC systems. In order to meet the requirements for more interactivity in supercomputing and to open up new possibilities in HPC, a simple and direct web access for starting and connecting to login or compute nodes with Jupyter or JupyterLab at Jülich Supercomputing Centre (JSC) is presented. To corroborate the flexibility of the new method, the motivation, applications, details and challenges of enabling interactive supercomputing, as well as goals and prospective future work will be discussed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://jupyter.org.

  2. 2.

    https://ipython.org.

  3. 3.

    https://jupyterlab.readthedocs.io.

  4. 4.

    https://jupyterhub.readthedocs.io.

  5. 5.

    https://jupyter-jsc.fz-juelich.de.

  6. 6.

    https://www.unity-idm.eu.

  7. 7.

    https://www.unicore.eu/.

  8. 8.

    https://www.rhinodiagnost.eu/.

  9. 9.

    https://keras.io.

  10. 10.

    https://www.tensorflow.org.

  11. 11.

    https://www.paraview.org.

  12. 12.

    https://wci.llnl.gov/simulation/computer-codes/visit.

References

  1. Benedyczak, K., Schuller, B., Petrova-ElSayed, M., Rybicki, J., Grunzke, R.: UNICORE 7 - middleware services for distributed and federated computing. In: 2016 International Conference on High Performance Computing and Simulation, Innsbruck, Austria, 18 July 2016–22 July 2016, pp. 613–620. IEEE (2016). https://doi.org/10.1109/HPCSim.2016.7568392. http://juser.fz-juelich.de/record/820611

  2. Goebbert, J.H., Gauding, M., Ansorge, C., Hentschel, B., Kuhlen, T., Pitsch, H.: Direct numerical simulation of fluid turbulence at extreme scale with psOpen. Adv. Parallel Comput. 27, 777–785 (2016). https://doi.org/10.3233/978-1-61499-621-7-777

    Article  Google Scholar 

  3. Lintermann, A., Göbbert, J.H., Vogt, K., Koch, W., Hetzel, A.: Rhinodiagnost: morphological and functional precision diagnostics of nasal cavities. Innov. Supercomput. Deutschl. 15(2), 106–109 (2017). http://juser.fz-juelich.de/record/840544

    Google Scholar 

  4. Lintermann, A., Meinke, M., Schröder, W.: Fluid mechanics based classification of the respiratory efficiency of several nasal cavities. Comput. Biol. Med. 43(11), 1833–1852 (2013). https://doi.org/10.1016/j.compbiomed.2013.09.003

    Article  Google Scholar 

  5. Lintermann, A., Schröder, W.: A hierarchical numerical journey through the nasal cavity: from nose-like models to real anatomies. Flow Turbul. Combust. 101, 1–28 (2017). https://doi.org/10.1007/s10494-017-9876-0

    Article  Google Scholar 

  6. Petrova-ElSayed, M., Benedyczak, K., Rutkowski, A., Schuller, B.: Federated computing on the web: the UNICORE portal. In: Proceedings of the 2016 39th International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia, 30 May 2016–3 June 2016, pp. 190–195. IEEE (2016). ISBN 978-953-233-086-1. https://doi.org/10.1109/MIPRO.2016.7522133. http://juser.fz-juelich.de/record/820398

Download references

Acknowledgement

This work is supported by the Rhinodiagnost project funded by the Zentrale Innovationsprogramm Mittelstand (ZIM) of the Federal Ministry of Economical Affairs and Energy (BMWi) and the InHPC-DE project as part of the SiVeGCS project to promote closer technical integration of the three GCS HPC centers in Stuttgart (HLRS), Jülich (JSC) and Munich (LRZ).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jens Henrik Göbbert .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Göbbert, J.H., Kreuzer, T., Grosch, A., Lintermann, A., Riedel, M. (2018). Enabling Interactive Supercomputing at JSC Lessons Learned. In: Yokota, R., Weiland, M., Shalf, J., Alam, S. (eds) High Performance Computing. ISC High Performance 2018. Lecture Notes in Computer Science(), vol 11203. Springer, Cham. https://doi.org/10.1007/978-3-030-02465-9_48

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-02465-9_48

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-02464-2

  • Online ISBN: 978-3-030-02465-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics