Abstract
Nowadays, household NAS service provides consumer device users a convenient way to extend their storage space through WLAN. As the core of NAS service, distributed file system’s objective is to make the whole system provide a good user experience. However, it is normal for consumer devices to work under unstable network conditions, which can significantly degrade the user experience. Moreover, user behavior is getting more complicated, which means traditional mainstream optimization techniques have little effect in this case. To improve user experience, this paper proposes several practical optimization solutions for a lightweight distributed file system. First, a set of client-side cache optimization schemes, including swap-based persistent caching and cross-device cache prefetching with the Markov method, are proposed to reduce remote access latency. Second, a task-aware write-back scheduling scheme is proposed to enhance the cache synchronization efficiency. Finally, a simple protocol based on multiple readers and single writer for multi-device access control is proposed. Experiments on real devices show that the average access latency can be reduced by 29.7% with swap-based client-side persistent caching. Cross-device prefetching reduces around 33% access latency in the best case. Average cache synchronization latency is reduced by 13.7% and the worst synchronization latency is reduced by 63.7% with write-back scheduling. Multi-device access protocol induced negligible overhead but works effectively on controlling concurrent accesses.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al Maruf, H., Chowdhury, M.: Effectively prefetching remote memory with leap. In: 2020 USENIX Annual Technical Conference (USENIX ATC 20), pp. 843–857 (2020)
Arteaga, D., Zhao, M.: Client-side flash caching for cloud systems. In: Proceedings of International Conference on Systems and Storage, pp. 1–11 (2014)
Arteaga, D., Cabrera, J., Xu, J., Sundararaman, S., Zhao, M.: \(\{\)CloudCache\(\}\): On-demand flash cache management for cloud computing. In: 14th USENIX Conference on File and Storage Technologies (FAST 16), pp. 355–369 (2016)
Byan, S., Lentini, J., Madan, A., Pabon, L., Condict, M., Kimmel, J., Kleiman, S., Small, C., Storer, M.: Mercury: Host-side flash caching for the data center. In: 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST), pp. 1–12 (2012). IEEE
Fengguang, W., Hongsheng, X., Chenfeng, X.: On the design of a new linux readahead framework. ACM SIGOPS Operat. Syst. Rev. 42(5), 75–84 (2008)
Gibson, G.A., Van Meter, R.: Network attached storage architecture. Commun. ACM 43(11), 37–45 (2000)
Holland, D.A., Angelino, E., Wald, G., Seltzer, M.I.: Flash caching on the storage client. In: 2013 USENIX Annual Technical Conference (USENIX ATC 13), pp. 127–138 (2013)
Howard, J.H., Kazar, M.L., Menees, S.G., Nichols, D.A., Satyanarayanan, M., Sidebotham, R.N., West, M.J.: Scale and performance in a distributed file system. ACM Trans. Comput. Syst. (TOCS) 6(1), 51–81 (1988)
Howells, D., et al.: Fs-cache: A network filesystem caching facility. In: Proceedings of the Linux Symposium, vol. 1, pp. 427–440 (2006). Citeseer
Koller, R., Marmol, L., Rangaswami, R., Sundararaman, S., Talagala, N., Zhao, M.: Write policies for host-side flash caches. In: 11th USENIX Conference on File and Storage Technologies (FAST 13), pp. 45–58 (2013)
Laga, A., Boukhobza, J., Koskas, M., Singhoff, F.: Lynx: A learning linux prefetching mechanism for ssd performance model. In: 2016 5th Non-Volatile Memory Systems and Applications Symposium (NVMSA), pp. 1–6 (2016). IEEE
Lamport, L.: The part-time parliament. In: Concurrency: the Works of Leslie Lamport, pp. 277–317 (2019)
Liang, S., Jiang, S., Zhang, X.: Step: Sequentiality and thrashing detection based prefetching to improve performance of networked storage servers. In: 27th International Conference on Distributed Computing Systems (ICDCS’07), pp. 64–64 (2007). IEEE
Ongaro, D., Ousterhout, J.: In search of an understandable consensus algorithm. In: 2014 USENIX Annual Technical Conference (Usenix ATC 14), pp. 305–319 (2014)
Pawlowski, B., Noveck, D., Robinson, D., Thurlow, R.: The nfs version 4 protocol. In: In Proceedings of the 2nd International System Administration and Networking Conference (SANE 2000 (2000)
Qin, D., Brown, A.D., Goel, A.: Reliable writeback for client-side flash caches. In: 2014 USENIX Annual Technical Conference (USENIX ATC 14), pp. 451–462 (2014)
Sandberg, R., Goldberg, D., Kleiman, S., Walsh, D., Lyon, B.: Design and implementation of the sun network filesystem. In: Proceedings of the Summer 1985 USENIX Conference, pp. 119–130 (1985)
Satyanarayanan, M., Kistler, J.J., Kumar, P., Okasaki, M.E., Siegel, E.H., Steere, D.C.: Coda: a highly available file system for a distributed workstation environment. IEEE Trans. Comput. 39(4), 447–459 (1990)
Schmuck, F., Haskin, R.: \(\{\)GPFS\(\}\): A \(\{\)Shared-Disk\(\}\) file system for large computing clusters. In: Conference on File and Storage Technologies (FAST 02) (2002)
Wang, H., Luo, L., Shi, L., Li, C., Xue, C.J., Zhuge, Q., Sha, E.H.-M.: Sfp: Smart file-aware prefetching for flash based storage systems. In: Proceedings of the 2021 on Great Lakes Symposium on VLSI, pp. 45–50 (2021)
Acknowledgements
The authors would like to thank anonymous reviewers for their valuable comments. This work is supported by the NSFC 62141213, Shanghai Science and Technology Project (22QA1403300) and the Open Project Program of Wuhan National Laboratory for Optoelectronics NO. 2019WNLOKF008. The corresponding author is Liang Shi (shi.liang.hk@gmail.com).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xu, Y., Li, H., Wang, H. et al. Practical optimizations for lightweight distributed file system on consumer devices. CCF Trans. HPC 4, 474–491 (2022). https://doi.org/10.1007/s42514-022-00132-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42514-022-00132-w