skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

Conference · · 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS)

Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
2001242
Journal Information:
2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS), Conference: 16. Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis, St. Louis, MO (United States), 15 Nov 2021
Country of Publication:
United States
Language:
English

References (9)

Pegasus, a workflow management system for science automation journal May 2015
Practical Resource Monitoring for Robust High Throughput Computing conference September 2015
End-to-end online performance data capture and analysis for scientific workflows journal April 2021
A Community Roadmap for Scientific Workflows Research and Development conference November 2021
Developing accurate and scalable simulators of production workflow management systems with WRENCH journal November 2020
Teaching parallel and distributed computing concepts in simulation with WRENCH journal October 2021
Versatile, scalable, and accurate simulation of distributed applications and platforms journal October 2014
The Evolution of the Pegasus Workflow Management Software journal July 2019
Distributed computing in practice: the Condor experience
  • Thain, Douglas; Tannenbaum, Todd; Livny, Miron
  • Concurrency and Computation: Practice and Experience, Vol. 17, Issue 2-4, p. 323-356 https://doi.org/10.1002/cpe.938
journal January 2005