Skip to main content
SpringerLink
Log in

An Advanced Data Redistribution Approach to Accelerate the Scale-Down Process of RAID-6

  • Conference paper
Algorithms and Architectures for Parallel Processing (ICA3PP 2014)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8631))

  • 2649 Accesses

Abstract

Nowadays RAID is widely used with the increasing requirements of the reliability in storage systems and the fast development of cloud computing. Among various levels and implementations of RAID systems, RAID-6 is one of the most significant category with the ability to tolerate concurrent failures of any two disks. However, the scalability of RAID-6 is a big challenge. Although many approaches are proposed to accelerate the scaling process and reduce the overhead, how to efficiently remove disks (refers to scale-down process) from existing array is still an open problem.

To address the scalability problem, we propose an Advanced Data Redistribution (ADR) approach. The basic idea of ADR is to reorganize previous stripes in RAID-6 systems to achieve higher scalability. ADR is a stripe-level scheme and can be combined with other approaches as SDM and MDS-Frame. It can minimize the overhead of data migration and parity modification. We have conducted mathematical analysis by comparing ADR to various popular RAID-6 codes. The results show that, compared to typical approach (Round-Robin), ADR decreases more than 52.1% migration I/O operations, saves the migration time by up to 63.5%, and speeds up of the scaling process by up to 1.91.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Armbrust, M., Fox, A., et al.: Above the Clouds: A Berkeley View of Cloud Computing. Technical Report, UCB/EECS-2009-28 (2009)

    Google Scholar 

  2. Blaum, M., Brady, J., et al.: EVENODD: An Efficient Scheme for Tolerating Double Disk Failures in RAID Architectures. IEEE Trans. Computers 44, 192–202 (1995)

    Article  MATH  Google Scholar 

  3. Blaum, M., Roth, R.: On Lowest Density MDS Codes. IEEE Trans. Information Theory 45, 46–59 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  4. Cassuto, Y., Bruck, J.: Cyclic Lowest Density MDS Array Codes. IEEE Trans. Information Theory 55, 1721–1729 (2009)

    Article  MathSciNet  Google Scholar 

  5. Chen, P., Lee, E., et al.: RAID: High-Performance, Reliable Secondary Storage. ACM Computing Surveys 26, 145–185 (1994)

    Article  Google Scholar 

  6. Corbett, P., English, B., et al.: Row-Diagonal Parity for Double Disk Failure Correction. In: 3rd USENIX Conference on File and Storage Technologies, pp. 1–14. USENIX Press, San Francisco (2004)

    Google Scholar 

  7. Ghandeharizadeh, S., Kim, D.: On-line Reorganization of Data in Scalable Continuous Media Servers. In: Thoma, H., Wagner, R.R. (eds.) DEXA 1996. LNCS, vol. 1134, pp. 751–768. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  8. Goel, A., Shahabi, C., et al.: SCADDAR: An Efficient Randomized Technique to Reorganize Continuous Media Blocks. In: 18th International Conference on Data Engineering, pp. 478–482. IEEE Press, San Jose (2002)

    Google Scholar 

  9. Gonzalez, J., Cortes, T.: Increasing the Capacity of RAID5 by Online Gradual Assimilation. In: 2004 International Workshop on Storage Network Architecture and Parallel I/O, Antibes, Juan-les-pins, pp. 17–24 (2004)

    Google Scholar 

  10. Hetzler, S.: Storage Array Scaling Method and System with Minimal Data Movement. US Patent 20080276057 (2008)

    Google Scholar 

  11. Hwang, K., Jin, H., Ho, R.: RAID-x: A New Distributed Disk Array for I/O-Centric Cluster Computing. In: 9th IEEE International Symposium on High Performance Distributed Computing, pp. 279–286. IEEE Press, Pittsburgh (2000)

    Google Scholar 

  12. Jin, C., Jiang, H., et al.: P-Code: A New RAID-6 Code with Optimal Properties. In: 23rd International Conference on Supercomputing, pp. 360–369. ACM Press, New York (2009)

    Chapter  Google Scholar 

  13. Brown, N.: Online RAID-5 Resizing. drivers/md/raid5.c in the Source Code of Linux Kernel 2.6.18, http://www.kernel.org/

  14. Patterson, D.: A Simple Way to Estimate the Cost of Downtime. In: 16th USENIX Conference on Systems Administration, pp. 185–188. USENIX Press, Philadelphia (2002)

    Google Scholar 

  15. Patterson, D., Gibson, G., Katz, R.: A Case for Redundant Arrays of Inexpensive Disks (RAID). In: 1988 ACM SIGMOD International Conference on Management of Data, pp. 109–116. ACM Press, Chicago (1988)

    Chapter  Google Scholar 

  16. Pinheiro, E., Weber, W., Barroso, L.: Failure Trends in a Large Disk Drive Population. In: 5th USENIX Conference on File and Storage Technologies, pp. 17–28. USENIX Press, San Jose (2007)

    Google Scholar 

  17. Plank, J.: The RAID-6 Liberation Codes. In: 6th USENIX Conference on File and Storage Technologies, pp. 97–110. USENIX Press, San Jose (2008)

    Google Scholar 

  18. Reed, I., Solomon, G.: Polynomial Codes over Certain Finite Fields. Journal of the Society for Industrial and Applied Mathematics 8, 300–304 (1960)

    Article  MATH  MathSciNet  Google Scholar 

  19. Saito, Y., Frolund, S., et al.: FAB: Building Distributed Enterprise Disk Arrays from Commodity Components. In: 11th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 48–58. ACM Press, Boston (2004)

    Google Scholar 

  20. Schroeder, B., Gibson, G.: Disk Failures in the Real World: What does an MTTF of 1,000,000 Hours Mean to You? In: 5th USENIX Conference on File and Storage Technologies, pp. 1–16. USENIX Press, San Jose (2007)

    Google Scholar 

  21. Wu, C., He, X.: GSR: A Global Stripe-Based Redistribution Approach to Accelerate RAID-5 Scaling. In: 41st International Conference on Parallel Processing, pp. 460–469. IEEE Press, Pittsburgh (2012)

    Google Scholar 

  22. Wu, C., He, X., et al.: HDP code: A Horizontal-Diagonal Parity Code to Optimize I/O Load Balancing in RAID-6. In: 41st IEEE/IFIP International Conference on Dependable Systems and Networks, pp. 209–220. IEEE Press, Hong Kong (2011)

    Google Scholar 

  23. Wu, C., He, X., et al.: SDM: A Stripe-Based Data Migration Scheme to Improve the Scalability of RAID-6. In: 2012 IEEE International Conference on Cluster Computing, pp. 284–292. IEEE Press, Beijing (2012)

    Chapter  Google Scholar 

  24. Wu, C., Wan, S., et al.: H-Code: A Hybrid MDS Array Code to Optimize Partial Stripe Writes in RAID-6. In: 25th IEEE International Symposium on Parallel and Distributed Processing, pp. 782–793. IEEE Press, Anchorage (2011)

    Google Scholar 

  25. Xu, L., Bohossian, V., et al.: Low-Density MDS Codes and Factors of Complete Graphs. IEEE Trans. Information Theory 45, 1817–1826 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  26. Xu, L., Bruck, J.: X-Code: MDS Array Codes with Optimal Encoding. IEEE Trans. Information Theory 45, 272–276 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  27. Zhang, G., Shu, J., et al.: SLAS: An Efficient Approach to Scaling Round-Robin Striped Volumes. ACM Trans. Storage 3, 1–39 (2007)

    Article  Google Scholar 

  28. Zhang, G., Zheng, W., Shu, J.: ALV: A New Data Redistribution Approach to RAID-5 Scaling. IEEE Trans. Computers 59, 345–357 (2010)

    Article  MathSciNet  Google Scholar 

  29. Zheng, W., Zhang, G.: FastScale: Accelerate RAID Scaling by Minimizing Data Migration. In: 9th USENIX Conference on File and Storage Technologies, pp. 149–161. USENIX Press, San Jose (2011)

    Google Scholar 

  30. Wu, C., He, X.: A Flexible Framework to Enhance RAID-6 Scalability via Exploiting the Similarities among MDS Codes. In: 42nd International Conference on Parallel Processing, pp. 542–551. IEEE Press, Lyon (2013)

    Google Scholar 

  31. Miranda, A., Cortes, T.: CRAID: Online RAID Upgrades Using Dynamic Hot Data Reorganization. In: 12nd USENIX Conference on File and Storage Technologies, pp. 133–146. USENIX Press, Santa Clara (2014)

    Google Scholar 

  32. Zhang, G., Wang, J., et al.: Redistribute Data to Regain Load Balance during RAID-4 Scaling. IEEE Trans. Parallel Distrib. Syst. 25 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Shanghai Key Laboratory of Scalable Computing and Systems, Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China, 200240

    Congjin Du, Chentao Wu & Jie Li

Authors
  1. Congjin Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chentao Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Illinois Institute of Technology, 60616-3793, Chicago, IL, USA

    Xian-he Sun

  2. School of Computer Science and Technology, Dalian Maritime University, 1 Linghai Road, 116026, Dalian, China

    Wenyu Qu

  3. SEECS, University of Ottawa, 8, King Edward Ave, K1N 6N5, Ottawa, ON, Canada

    Ivan Stojmenovic

  4. Deakin University, 221 Burwood Highway, 3125, Burwood, VIC, Australia

    Wanlei Zhou

  5. Dalian Maritime University, NO.1 Linhai Road Dailian, 116026, China

    Zhiyang Li

  6. BeiHang University, XueYuan Road No.37, HaiDian District, Beijing, China

    Hua Guo

  7. University of Bradford, BD7 1DP, Bradford, West Yorkshire, United Kingdom

    Geyong Min

  8. Dalian Maritime University, NO.1 Linhai Road Dailian, China, 116026

    Tingting Yang

  9. Computer Network Information Center, Chinese Academy of Sciences, 100190, Beijing, China

    Yulei Wu

  10. Shandong University, 27 Shanda Nanlu, 250100, Jinan City, Shandong Province, China

    Lei Liu

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Du, C., Wu, C., Li, J. (2014). An Advanced Data Redistribution Approach to Accelerate the Scale-Down Process of RAID-6. In: Sun, Xh., et al. Algorithms and Architectures for Parallel Processing. ICA3PP 2014. Lecture Notes in Computer Science, vol 8631. Springer, Cham. https://doi.org/10.1007/978-3-319-11194-0_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11194-0_22

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11193-3

  • Online ISBN: 978-3-319-11194-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation