Vinicius Dantas de Lima Melo
Alexandre da Silva Veith
ABSTRACT
As IoT devices multiply and produce vast volumes of data, there is a heightened demand for instantaneous data processing. However, traditional cloud computing cannot adequately address these demands due to its latency and bandwidth limitations. Edge computing has emerged as a viable alternative with a hierarchical deployment of datacenters. However, this introduces additional layers of infrastructure and management that increase application development complexity. Using a shared file system is an attractive method for enhancing communication between components in an edge computing application.
In this paper we introduce PathFS, a shared file system designed for the hierarchical edge-cloud infrastructure. PathFS adopts a treelike structure, with cloud datacenters at the root, edge datacenters as leaves, and a variable number of network datacenters in between. We evaluate PathFS through benchmarks on an emulated hierarchical edge deployment and compare it with NFS and ownCloud. The results show that PathFS offers lower latency than these systems by an order of magnitude, and scales to a larger number of concurrent clients without performance impacts, providing an end-to-end latency reduction of at least 80%.
- [n. d.]. Common Objects in Context (COCO). https://cocodataset.org.Google Scholar
- [n.d.]. Guava. https://github.com/google/guava/releases/tag/v32.0.1.Google Scholar
- [n. d.]. inotify. https://man7.org/linux/man-pages/man7/inotify.7.html.Google Scholar
- [n.d.]. InterPlanetary File System (IPFS). https://ipfs.tech/.Google Scholar
- [n.d.]. ownCloud. https://owncloud.com/.Google Scholar
- Chamseddine Bouallegue and Julien Gascon-Samson. 2020. DynPubSub: A Peer-to-peer Overlay for Topic-based Pub/sub Systems Deployed at the Edge. In Proceedings of the International Middleware Conference Demos and Posters.Google ScholarDigital Library
- Peter Braam. 2019. The Lustre Storage Architecture. arXiv preprint arXiv:1903.01955 (2019).Google Scholar
- Philip H Carns, Walter B Ligon III, Robert B Ross, and Rajeev Thakur. 2000. PVFS: A Parallel File System for Linux Clusters. In Proceedings of the Annual Linux Showcase Conference.Google Scholar
- Harshit Gupta and Umakishore Ramachandran. 2018. Fogstore: A Geo-distributed Key-value Store Guaranteeing Low Latency for Strongly Consistent Access. In Proceedings of the ACM International Conference on Distributed and Event-based Systems.Google ScholarDigital Library
- J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, Robert N. Side-botham, and M. West. 1987. Scale and Performance in a Distributed File System. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).Google Scholar
- Anuj Kalia, Michael Kaminsky, and David G Andersen. 2016. FaSST: Fast, Scalable and Simple Distributed Transactions with Two-Sided RDMA Datagram RPCs. In USENIX Symposium on Operating Systems Design and Implementation (OSDI).Google Scholar
- James J. Kistler and M. Satyanarayanan. 1991. Disconnected Operation in the Coda File System. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP).Google Scholar
- Avinash Lakshman and Prashant Malik. 2010. Cassandra: A Decentralized Structured Storage System. SIGOPS Operating Systems Review (2010).Google Scholar
- David L Mills. 1985. Network time protocol (NTP). Technical Report.Google Scholar
- Dave Minturn and J Metz. 2015. Under the Hood with NVMe over Fabrics. In Ethernet Storage Forum. SNIA.Google Scholar
- Sumit Kumar Monga, Sheshadri K Ramachandra, and Yogesh Simmhan. 2019. ElfStore: A Resilient Data Storage Service for Federated Edge and Fog Resources. In IEEE International Conference on Web Services (ICWS).Google Scholar
- Seyed Hossein Mortazavi, Mohammad Salehe, Bharath Balasubramanian, Eyal de Lara, and Shankaranarayanan PuzhavakathNarayanan. 2020. SessionStore: A Session-aware Datastore for the Edge. In IEEE International Conference on Fog and Edge Computing(ICFEC).Google Scholar
- Seyed Hossein Mortazavi, Mohammad Salehe, Carolina Simoes Gomes, Caleb Phillips, and Eyal De Lara. 2017. CloudPath: A Multi-Tier Cloud Computing Framework. In ACM/IEEE Symposium on Edge Computing (SEC).Google ScholarDigital Library
- Edmund B Nightingale and Jason Flinn. 2004. Energy-efficiency and Storage Flexibility in the Blue File System.. In USENIX Symposium on Operating Systems Design and Implementation (OSDI).Google Scholar
- Brian Pawlowski, David Noveck, David Robinson, and Robert Thurlow. 2000. The NFS Version 4 Protocol. In Proceedings of the International System Administration and Networking Conference.Google Scholar
- John Rydning, Marcia Walker, and Amy Machado. 2022. Worldwide IDC Global DataSphere IoT Device Installed Base and Data Generated Forecast, 2022--2026. In International Data Corporation Market Forecast.Google Scholar
- Russel Sandberg. 1986. The Sun Network File System: Design, Implementation and Experience. In USENIX Technical Conference and Exhibition.Google Scholar
- Julian Satran, Kalman Meth, C Sapuntzakis, M Chadalapaka, and E Zeidner. 2004. Internet Small Computer Systems Interface (iSCSI). Technical Report.Google Scholar
- Frank Schmuck and Roger Haskin. 2002. GPFS: A Shared-Disk File System for Large Computing Clusters. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST).Google ScholarDigital Library
- Philip Schwan. 2003. Lustre: Building a File System for 1000-Node Clusters. In Proceedings of the Linux Symposium.Google Scholar
- Konstantin Shvachko, Hairong Kuang, Sanjay Radia, and Robert Chansler. 2010. The Hadoop Distributed File System. In IEEE Symposium on Mass Storage Systems and Technologies (MSST).Google Scholar
- Bharath Kumar Reddy Vangoor, Vasily Tarasov, and Erez Zadok. 2017. To FUSE or Not to FUSE: Performance of User-Space File Systems. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST).Google Scholar
- Blesson Varghese, Eyal De Lara, Aaron Yi Ding, Cheol-Ho Hong, Flavio Bonomi, Schahram Dustdar, Paul Harvey, Peter Hewkin, Weisong Shi, Mark Thiele, et al. 2021. Revisiting the Arguments for Edge Computing Research. IEEE Internet Computing(2021).Google Scholar
- Shengan Zheng, Jingyu Wang, Dongliang Xue, Jiwu Shu, and Linpeng Huang. 2022. Hydra: A Decentralized File System for Persistent Memory and RDMA Networks. IEEE Transactions on Parallel and Distributed Systems (2022).Google Scholar
Index Terms
- PathFS: A File System for the Hierarchical Edge
Recommendations
All one needs to know about fog computing and related edge computing paradigms: A complete survey
AbstractWith the Internet of Things (IoT) becoming part of our daily life and our environment, we expect rapid growth in the number of connected devices. IoT is expected to connect billions of devices and humans to bring promising advantages ...
A Survey of Fog Computing: Concepts, Applications and Issues
Mobidata '15: Proceedings of the 2015 Workshop on Mobile Big DataDespite the increasing usage of cloud computing, there are still issues unsolved due to inherent problems of cloud computing such as unreliable latency, lack of mobility support and location-awareness. Fog computing can address those problems by ...
Edge computing: A survey
AbstractIn recent years, the Edge computing paradigm has gained considerable popularity in academic and industrial circles. It serves as a key enabler for many future technologies like 5G, Internet of Things (IoT), augmented reality and ...
Highlights- A comprehensive survey on edge computing, i.e., Fog, Mobile-edge and Cloudlet.
- ...
Comments