Sai Narasimhamurthy
Glenn Lockwood
ABSTRACT
Exciting changes are coming to the fore in the world of Storage and I/O for High Performance and Data Intensive computing. Existing data access and data retrieval methods that suitably support the new generation of data intensive applications in the realm of HPC and AI are being re-assessed. These new applications need to support both evolutionary as well as revolutionary approaches to data access and storage. Open source is enabling the adoption of these new techniques. This workshop looks at cutting edge trends in storage systems and solutions for data intensive HPC and AI applications with specific focus primarily on community driven initiatives and commercial products that may inspire the community.
- GitHub. 2022. GitHub - Seagate/cortx: CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.. [online] Available at: https://github.com/Seagate/cortx [Accessed 5 May 2022].Google Scholar
- MinIO. 2022. MinIO | High Performance, Kubernetes Native Object Storage. [online] Available at: https://min.io/ [Accessed 5 May 2022].Google Scholar
- GitHub. 2022. GitHub - ceph/ceph: Ceph is a distributed object, block, and file storage platform. [online] Available at: https://github.com/ceph/ceph [Accessed 5 May 2022].Google Scholar
- GitHub. 2022. GitHub - daos-stack/daos: DAOS Storage Stack (client libraries, storage engine, control plane). [online] Available at: https://github.com/daos-stack/daos [Accessed 5 May 2022].Google Scholar
- DAOS Presentation 2015. [online] Available at: https://www.snia.org/sites/default/files/SDC15_presentations/dist_sys/EricBarton_DAOS_Architecture_Extreme_Scale.pdf [Accessed 5 May 2022].Google Scholar
- Sai Narasimhamurthy, Nikita Danilov, Sining Wu, Ganesan Umanesan, Steven Wei Der Chien, Sergio Rivas-Gomez, Ivy Bo Peng, Erwin Laure, Shaun de Witt, Dirk Pleiter, and Stefano Markidis. 2018. The SAGE project: a storage centric approach for exascale computing: invited paper. In Proceedings of the 15th ACM International Conference on Computing Frontiers (CF'18). Association for Computing Machinery, New York, NY, USA, 287--292. https://doi.org/10.1145/3203217.3205341Google ScholarDigital Library
Index Terms
- EMOSS '22: Workshop on Emerging Open Storage Systems and Solutions for Data Intensive Computing
Recommendations
Opportunities and Challenges in Running Scientific Workflows on the Cloud
CYBERC '11: Proceedings of the 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge DiscoveryCloud computing is gaining tremendous momentum in both academia and industry. The application of Cloud computing, however, has mostly focused on Web applications and business applications; while the recognition of using Cloud computing to support large-...
A distributed multi-storage I/O system for data intensive scientific computing
Special issue: Parallel and distributed scientific and engineering computingMore and more parallel applications are running in a distributed environment to take advantage of easily available and inexpensive commodity resources. For data intensive applications, employing multiple distributed storage resources has many ...
FlexScience'22: 12th Workshop on AI and Scientific Computing at Scale using Flexible Computing Infrastructures
HPDC '22: Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed ComputingScientific computing applications generate enormous datasets that are continuously increasing exponentially in both complexity and volume, making their analysis, archival, and sharing one of the grand challenges of modern big data analytics. Supported ...
Comments