skip to main content
10.1145/3211890.3211894acmconferencesArticle/Chapter ViewAbstractPublication PagessystorConference Proceedingsconference-collections
research-article

The Quick Migration of File Servers

Published: 04 June 2018 Publication History

Abstract

Upgrading file servers is indispensable for improving the performance, reducing the possibility of failures, and reducing the power consumption. To upgrade file servers, files must be migrated from the old to new servers, which poses three challenges: reducing the downtime during migration, reducing the migration overhead, and supporting the migration between heterogeneous servers. Existing technologies are difficult to achieve all of the three challenges. We propose a quick file migration scheme for heterogeneous servers. To reduce the downtime, we exploit the post-copy approach and introduce on-demand migration that allows file access before completing the migration. To reduce the overhead, we introduce background migration that migrates files as soon as possible without affecting the performance and incurs no overhead after the migration. To support heterogeneity, we introduce stub-based file management that requires no internal states of the old server. We implemented our scheme for Linux and supported the NFS and SMB protocols. The experimental results depict that the downtime was a maximum of 23 s in a 4-level 1000-file directory and the migration time was 70 min in NFS and 204 min in SMB with 242 GiB of data.

References

[1]
Ted Anderson, Leo Luan, Craig Everhart, Manuel Pereira, Ronnie Sarkar, and Jane Xu. 2004. Global namespace for files. IBM Systems Journal 43, 4 (2004), 702--722.
[2]
Alain Azagury, Michael E. Factor, Julian Satran, and William Micka. 2002. Point-in-Time Copy: Yesterday, Today and Tomorrow. In Proceedings of 19th IEEE Mass Storage Systems and Technologies. 259--270.
[3]
Ellie Berriman and Binguxe Cai. 2011. NetApp Storage System Multiprotocol users guide. Technical Report 3490. NetApp. http://www.netapp.com/us/media/tr-3490.pdf
[4]
Brent Callaghan, Brian Pawlowski, and Peter Staubach. 1995. Network File System (NFS) Version 3 Protocol Specification. Internet Requests for Comments. (1995). https://www.rfc-editor.org/info/rfc1813
[5]
Data Dynamics Inc. 2017. StorageX 8.0. (2017). Retrieved 2018-04-28 from https://www.datadynamicsinc.com/launch/
[6]
John R. Douceur and William J. Bolosky. 1999. A Large-scale Study of File-system Contents. In Proceedings of the 1999 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS '99). ACM, New York, NY, USA, 59--70.
[7]
Allen B. Downey. 2001. The structural cause of file size distributions. In Proceedings of the 9th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS 2001). 361--370.
[8]
EMC Corporation. 2009. EMC Rainfinity File Management Appliance Getting Started Guide. (2009). Retrieved 2018-04-28 from https://www.emc.com/collateral/TechnicalDocument/docu8513.pdf
[9]
Marc Eshel, Roger Haskin, Dean Hildebrand, Manoj Naik, Frank Schmuck, and Renu Tewari. 2010. Panache: A Parallel File System Cache for Global File Access. In Proceedings of the 8th USENIX Conference on File and Storage Technologies. 155--168.
[10]
F5 Networks, Inc. 2013. ARX Series Datasheet. (2013). Retrieved 2018-04-28 from https://www.f5.com/pdf/products/arx-series-ds.pdf
[11]
Steven M. French. 2007. A New Network File System is Born: Comparison of SMB2, CIFS, and NFS. In Proceedings of Linux Symposium, Vol. 1. 131--140.
[12]
Thomas Haynes. 2016. Network File System (NFS) Version 4 Minor Version 2 Protocol. Internet Requests for Comments. (2016). https://www.rfc-editor.org/info/rfc7862
[13]
Michael R. Hines, Umesh Deshpande, and Kartik Gopalan. 2009. Post-copy Live Migration of Virtual Machines. SIGOPS Operating System Review 43, 3 (July 2009), 14--26.
[14]
Dave Hitz, Bridget Allison, Andrea Borr, Rob Hawley, and Mark Muhlestein. 1998. Merging NT and UNIX Filesystem Permissions. In Proceedings of the 2nd USENIX Windows NT Symposium. 10.
[15]
Intel, Inc. 2013. Planning Guide: Updating IT Infrastructure. (2013). http://www.intel.com/content/dam/www/public/us/en/documents/guides/server-refresh-planning-guide.pdf
[16]
JM Project. 1993. Linux Programmer's Manual: NFS. (1993). Retrieved 2018-04-28 from https://linuxjm.osdn.Jp/html/util-linux/man5/nfs.5.html
[17]
Nemoto Jun, Sutoh Atsushi, and Iwasaki Masaaki. 2017. Directory-Aware File System Backup to Object Storage for Fast On-Demand Restore. International Journal of Smart Computing and Artificial Intelligence 1, 1 (2017), 1--19.
[18]
Ali Mashtizadeh, Emré Celebi, Tal Garfinkel, and Min Cai. 2011. The Design and Evolution of Live Storage Migration in VMware ESX. In Proceedings of the 2011 USENIX Annual Technical Conference. 1--14.
[19]
Dutch T. Meyer and William J. Bolosky. 2011. A Study of Practical Deduplication. In Proceedings of the 9th USENIX Conference on File and Stroage Technologies. 1--14.
[20]
Microsoft. 2009. Windows Server Migration Tools and Guides. (2009). Retrieved 2018-04-28 from https://technet.microsoft.com/en-us/library/dd759159(v=ws.11).aspx
[21]
Microsoft TechNet. 2016. Command-Line Reference Robocopy. (2016). Retrieved 2018-04-28 from https://technet.microsoft.com/en-us/library/cc733145(v=ws.11).aspx
[22]
Edgar A. Olougouna. 2013. SMB 2.x and SMB 3.0 Timeouts in Windows. (2013). Retrieved 2018-04-28 from https://blogs.msdn.microsoft.com/openspecification/2013/03/27/smb-2-x-and-smb-3-0-timeouts-in-windows/
[23]
NFS-Ganesha project. 2017. NFS-Ganesha Wiki: Fsalsupport. (2017). Retrieved 2018-04-28 from https://github.com/nfs-ganesha/nfs-ganesha/wiki/Fsalsupport
[24]
QEMU Wiki. 2011. Image Streaming API. (2011). Retrieved 2018-04-28 from https://wiki.qemu.org/Features/ImageStreamingAPI
[25]
Samba Team. 2017. Samba Wiki: Writing a Samba VFS Module. (2017). Retrieved 2018-04-28 from https://wiki.samba.org/index.php/Writing_aSamba_VFS_Module
[26]
Bianca Schroeder and Garth A. Gibson. 2007. Understanding Disk Failure Rates: What Does an MTTF of 1,000,000 Hours Mean to You? ACM Transactions on Storage 3, 3, Article 8 (Oct. 2007).
[27]
Spencer Shepler, Mike Eisler, and David Noveck. 2010. Network File System (NFS) Version 4 Minor Version 1 Protocol. Internet Requests for Comments. (2010). http://www.rfc-editor.org/rfc/rfc5661.txt
[28]
Andrew S. Tanenbaum. 2007. Modern Operating Systems (3rd ed.). Prentice Hall Press.
[29]
TechTarget. 2017. NAS trifecta: Price, features and performance. Storage Magazine 16, 8 (2017), 14.
[30]
TechTarget. 2017. Snapshot 1: New NAS buys motivated by performance and outdated hardware. Storage Magazine 16, 2 (2017), 12.
[31]
Andrew Tridgell and Paul Mackerras. 1996. The rsync algorithm. Technical Report TR-CS-96-05. ANU Research Publications.
[32]
Tarasov Vasily, Zadok Erez, and Shepler Spencer. 2016. Filebench: A Flexible Framework for File System Benchmarking. ;login: The Usenix Magazine 41, 1 (2016), 6--12.
[33]
Michael Vrable, Stefan Savage, and Geoffrey M. Voelker. 2009. Cumulus: Filesystem Backup to the Cloud. ACM Transactions on Storage (TOS) 5, 4, Article 14 (Dec. 2009), 28 pages.
[34]
Katsurashima Wataru, Yamakawa Satoshi, Torii Takashi, Ishikawa Jun, Kikuchi Yoshihide, Yamaguti Kouji, Fujii Kazuaki, and Nakashima Toshihiro. 2003. NAS switch: a novel CIFS server virtualization. In Proceedings of 20th IEEE Mass Storage Systems and Technologies. 82--86.
[35]
Mike Worthon. 2012. SnapMirror Configuration and Best Practices Guide for Clustered Data ONTAP. Technical Report 4015. NetApp. https://www.netapp.com/us/media/tr-4015.pdf
[36]
Yasuda Yoshiko, Kawamoto Shinichi, Ebata Atsushi, Okitsu Jun, and Higuchi Tatsuo. 2003. Concept and evaluation of X-NAS: a highly scalable NAS system. In Proceedings of 20th IEEE Mass Storage Systems and Technologies. 219--227.

Cited By

View all
  • (2024)Key Management Server Design in Multiuser Environment for Critical File ProtectionJournal of information and communication convergence engineering10.56977/jicce.2024.22.2.12122:2(121-126)Online publication date: 30-Jun-2024
  • (2020)GoSeedProceedings of the 18th USENIX Conference on File and Storage Technologies10.5555/3386691.3386710(193-208)Online publication date: 24-Feb-2020
  • (2020)Practical Quick File Server MigrationACM Transactions on Storage10.1145/337732216:2(1-30)Online publication date: 23-May-2020
  • Show More Cited By

Index Terms

  1. The Quick Migration of File Servers

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SYSTOR '18: Proceedings of the 11th ACM International Systems and Storage Conference
    June 2018
    144 pages
    ISBN:9781450358491
    DOI:10.1145/3211890
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. File server
    2. migration
    3. post-copy

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SYSTOR '18
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 108 of 323 submissions, 33%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Key Management Server Design in Multiuser Environment for Critical File ProtectionJournal of information and communication convergence engineering10.56977/jicce.2024.22.2.12122:2(121-126)Online publication date: 30-Jun-2024
    • (2020)GoSeedProceedings of the 18th USENIX Conference on File and Storage Technologies10.5555/3386691.3386710(193-208)Online publication date: 24-Feb-2020
    • (2020)Practical Quick File Server MigrationACM Transactions on Storage10.1145/337732216:2(1-30)Online publication date: 23-May-2020
    • (2019)Lightweight Dynamic Redundancy Control for Server-Based Storage2019 38th Symposium on Reliable Distributed Systems (SRDS)10.1109/SRDS47363.2019.00042(295-29509)Online publication date: Oct-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media