Skip to main content
SpringerLink
Log in

The Need for Pervasive In Situ Analysis and Visualization (P-ISAV)

  • Conference paper
  • First Online:
High Performance Computing. ISC High Performance 2022 International Workshops (ISC High Performance 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13387))

Included in the following conference series:

Abstract

A major direction for big science is the coupling of HPC, experimental and observational facilities into computing ecosystems. These ecosystems will provide unprecedented tools for scientific inquiry. At the same time, these systems, which are complex, distributed and heterogeneous, will be a significant challenge for the visualization tools of today. In this position paper, we present our thoughts and key properties on a fundamental requirement of future solutions: pervasive in situ visualization (P-ISAV).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ayachit, U., et al.: Paraview catalyst: enabling in situ data analysis and visualization. In: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, pp. 25–29. ACM (2015)

    Google Scholar 

  2. Ayachit, U., et al.: Performance analysis, design considerations, and applications of extreme-scale in situ infrastructures. In: ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC16). Salt Lake City, UT, USA, November 2016. https://doi.org/10.1109/SC.2016.78, LBNL-1007264

  3. Bauer, A., et al.: In situ methods, infrastructures, and applications on high performance computing platforms. In: Computer Graphics Forum, vol. 35, pp. 577–597. Wiley Online Library (2016)

    Google Scholar 

  4. CDW: Infrastructure as a service, November 2018. https://webobjects.cdw.com/webobjects/media/pdf/Solutions/cloud-computing/Cloud-IaaS.pdf

  5. Childs, H., et al.: A terminology for in situ visualization and analysis systems. Int. J. High Perform. Comput. Appl. 34(6), 676–691 (2020)

    Article  Google Scholar 

  6. Dorier, M., Yildiz, O., Peterka, T., Ross, R.: The challenges of elastic in situ analysis and visualization. In: Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, pp. 23–28 (2019)

    Google Scholar 

  7. Dragoni, N., et al.: Microservices: yesterday, today, and tomorrow. CoRR abs/1606.04036 (2016). https://arxiv.org/abs/1606.04036

  8. Duque, E.P., et al.: Epic-an extract plug-in components toolkit for in situ data extracts architecture. In: 22nd AIAA Computational Fluid Dynamics Conference, p. 3410 (2015)

    Google Scholar 

  9. Fogal, T., et al.: Freeprocessing: transparent in situ visualization via data interception. In: Eurographics Symposium on Parallel Graphics and Visualization: EG PGV, vol. 2014, p. 49. NIH Public Access (2014)

    Google Scholar 

  10. Godoy, W., et al.: ADIOS 2: the adaptable input output system. a framework for high-performance data management. SoftwareX 12, 100561 (2020). https://doi.org/10.1016/j.softx.2020.100561

  11. Hang, H., Dibie, O.: Software as a service. https://www.cs.colorado.edu/~kena/classes/5828/s12/presentation-materials/dibieogheneovohanghaojie.pdf

  12. Hobson, T., et al.: Interactive visualization of large turbulent flow as a cloud service. IEEE Trans. Cloud Comput. 1 (2021)

    Google Scholar 

  13. Kress, J., et al.: Comparing the efficiency of in situ visualization paradigms at scale. In: Weiland, M., Juckeland, G., Trinitis, C., Sadayappan, P. (eds.) ISC High Performance 2019. LNCS, vol. 11501, pp. 99–117. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20656-7_6

    Chapter  Google Scholar 

  14. Kress, J., et al.: Opportunities for cost savings with in-transit visualization. In: ISC High Performance 2020. ISC (2020)

    Google Scholar 

  15. Larsen, M., et al.: Performance modeling of in situ rendering. In: SC 2016: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, pp. 276–287. IEEE (2016)

    Google Scholar 

  16. Larsen, M., et al.: The ALPINE in situ infrastructure: ascending from the ashes of strawman. In: Proceedings of the In Situ Infrastructures on Enabling Extreme-Scale Analysis and Visualization, pp. 42–46. ACM (2017)

    Google Scholar 

  17. Lawrence Livermore National Laboratory: Blueprint. https://llnl-conduit.readthedocs.io/en/latest/blueprint.html. Accessed 6 Sep 2020

  18. Lian, M.: Introduction to service oriented architecture, March 2012. https://www.cs.colorado.edu/~kena/classes/5828/s12/presentation-materials/lianming.pdf

  19. Moreland, K., et al.: Minimizing development costs for efficient many-core visualization using MCD\({}^{\text{3 }}\). Parallel Comput. 108, 102834 (2021)

    Article  MathSciNet  Google Scholar 

  20. Moreland, K., et al.: VTK-m: accelerating the visualization toolkit for massively threaded architectures. IEEE Comput. Graph. Appl. 36(3), 48–58 (2016)

    Article  Google Scholar 

  21. Peterka, T., et al.: ASCR workshop on in situ data management: enabling scientific discovery from diverse data sources. Technical report, U.S. DOE ASCR, February 2019. https://doi.org/10.2172/1493245

  22. Pugmire, D., et al.: Visualization as a service for scientific data. In: Smoky Mountains Computational Sciences and Engineering Conference, pp. 157–174. Kingsport, TN, August 2020

    Google Scholar 

  23. Pugmire, D., et al.: Fides: a general purpose data model library for streaming data. In: Jagode, H., Anzt, H., Ltaief, H., Luszczek, P. (eds.) ISC High Performance 2021. LNCS, vol. 12761, pp. 495–507. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-90539-2_34

    Chapter  Google Scholar 

  24. Raji, M., et al.: Scalable web-embedded volume rendering. In: Proceedings of the IEEE Symposium on Large Data Analysis and Visualization (LDAV), pp. 45–54, October 2017. https://doi.org/10.1109/LDAV.2017.8231850

  25. Raji, M., et al.: Scientific visualization as a microservice. IEEE Trans. Vis. Comput. Graph. 26(4), 1760–1774 (2020)

    Google Scholar 

  26. Rivi, M., et al.: In-situ visualization: State-of-the-art and some use cases. PRACE White Paper; PRACE: Brussels, Belgium (2012)

    Google Scholar 

  27. Saha, S., et al.: NCEP Climate Forecast System Version 2 (CFSv2) 6-Hourly Products (2011). https://doi.org/10.5065/D61C1TXF

  28. Tchoua, R., et al.: Adios visualization schema: a first step towards improving interdisciplinary collaboration in high performance computing. In: eScience (eScience), 2013 IEEE 9th International Conference on eScience, pp. 27–34. IEEE (2013)

    Google Scholar 

  29. Wang, Z., Dorier, M., Subedi, P., Davis, P.E., Parashar, M.: An adaptive elasticity policy for staging based in-situ processing. In: 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS), pp. 33–41. IEEE (2021)

    Google Scholar 

  30. Whitlock, B., et al.: Parallel in situ coupling of simulation with a fully featured visualization system. In: Eurographics Symposium on Parallel Graphics and Visualization. The Eurographics Association (2011). https://doi.org/10.2312/EGPGV/EGPGV11/101-109

Download references

Author information

Authors and Affiliations

  1. Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA

    David Pugmire, Kenneth Moreland & Scott Klasky

  2. University of Tennessee, Knoxville, TN, 37996, USA

    Jian Huang

Authors
  1. David Pugmire
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jian Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kenneth Moreland
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Scott Klasky
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Pugmire .

Editor information

Editors and Affiliations

  1. University of Tennessee, Knoxville, TN, USA

    Hartwig Anzt

  2. University of New Mexico, Albuquerque, NM, USA

    Amanda Bienz

  3. University of Tennessee, Knoxville, TN, USA

    Piotr Luszczek

  4. Université Paris-Saclay, Orsay, France

    Marc Baboulin

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pugmire, D., Huang, J., Moreland, K., Klasky, S. (2022). The Need for Pervasive In Situ Analysis and Visualization (P-ISAV). In: Anzt, H., Bienz, A., Luszczek, P., Baboulin, M. (eds) High Performance Computing. ISC High Performance 2022 International Workshops. ISC High Performance 2022. Lecture Notes in Computer Science, vol 13387. Springer, Cham. https://doi.org/10.1007/978-3-031-23220-6_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-23220-6_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-23219-0

  • Online ISBN: 978-3-031-23220-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation