Skip to main content
Springer Nature Link
Log in

Distributing Orthogonal Redundancy on Adaptive Disk Arrays

  • Conference paper
On the Move to Meaningful Internet Systems: OTM 2008 (OTM 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5331))

  • 1303 Accesses

Abstract

When upgrading storage systems, the key is migrating data from old storage subsystems to the new ones for achieving a data layout able to deliver high performance I/O, increased capacity and strong data availability while preserving the effectiveness of its location method.

However, achieving such data layout is not trivial when handling a redundancy scheme because the migration algorithm must guarantee both data and redundancy will not be allocated on the same disk. The Orthogonal redundancy for instance delivers strong data availability for distributed disk arrays but this scheme is basically focused on homogeneous and static environments and a technique that moves overall data layout called re-striping is applied when upgrading it.

This paper presents a deterministic placement approach for distributing orthogonal redundancy on distributed heterogeneous disk arrays, which is able to adapt on-line the storage system to the capacity/performance demands by only moving a fraction of data layout.

The evaluation reveals that our proposal achieve data layouts delivering an improved performance and increased capacity while keeping the effectiveness of the redundancy scheme even after several migrations. Finally, it keeps the complexity of the data management at an acceptable level.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Charles, P., Good, N., Jordan, L.L., Lyman, P., Varian, H.R., Pal, J.: How much information? (2004), http://www2.sims.berkeley.edu/research/projects/how-much-info-2003/printable_report.pdf

  2. Coffman, K.G., Odlyzko, A.M.: Internet growth: is there a moore’s law for data traffic?, pp. 47–93 (2002)

    Google Scholar 

  3. Grochowski, E., Halem, R.D.: Technological impact of magnetic hard disk drives on storage systems. IBM Syst. J. IBM Corp., 338–346 (2003)

    Google Scholar 

  4. Ailamaki, A., DeWitt, D.J., Hill, M.D., Wood, D.A.: Dbmss on a modern processor: Where does time go?, pp. 266–277 (1999)

    Google Scholar 

  5. Yellin, R.: The data storage evolution. has disk capacity outgrown its usefulness? Terada magazine (2006)

    Google Scholar 

  6. Cortes, T., Labarta, J.: Taking advantage of heterogeneity in disks arrays. Journal of Parallel and distributing Computing 63, 448–464 (2003)

    Article  Google Scholar 

  7. Gibson, G., Patterson, D.A., Katz, R.H.: A case for redundant arrays of inexpensive disks (raid). SIGMOD, pp. 109–116 (1988)

    Google Scholar 

  8. Kai Hwang, R.S.C., Ho, H.J.: Orthogonal striping and mirroring in distributed raid for i/o-centric cluster computing. PDS, IEEE Transactions 2002, 26–44 (2002)

    Google Scholar 

  9. Holland, M., Gibson, G.: Parity declustering for continuous operation in redundant disk arrays. In: ASPLOS-V, pp. 23–35 (1992)

    Google Scholar 

  10. Gibson, G.A., Patterson, D.A.: Designing disk arrays for high data reliability. Journal of Parallel and Distributed Computing, 4–27 (1993)

    Google Scholar 

  11. Kai Hwang, R.S.C., Ho, H.J.: Raid x. IEEE Transactions on Parallel and Distributed Systems 13(1), 26–44 (2002)

    Article  Google Scholar 

  12. Santos, J.R., Muntz, R.: Performance analysis of the rio multimedia storage system with heterogeneous disk configurations. In: ACM 1998, pp. 303–308 (1998)

    Google Scholar 

  13. Brinkmann, A., Effert, S., Heidebuer, M., Vodisek, M.: Influence of adaptive data layouts on performance in dynamically changing storage environments. In: PDP 2006, pp. 155–162 (2006)

    Google Scholar 

  14. Maulschagen, H.: Logical volume management for linux

    Google Scholar 

  15. Nagle, D., Serenyi, D., Matthews, A.: The panasas activescale storage cluster: Delivering scalable high bandwidth storage. In: SC 2004, p. 53 (2004)

    Google Scholar 

  16. Lionel, M., Chen, N.Y., Yang, M.: Costore: A storage cluster architecture using network attached storage devices. In: Proceedings of the Ninth ICPADS 2002 (2002)

    Google Scholar 

  17. Gonzalez, J.L., Cortes, T.: Adaptive data placement based on deterministic zones (adaptivez). In: GADA 2007, page pending (2007)

    Google Scholar 

  18. Yu, W., Liang, S., Panda, D.K.: Adaptive data availability for chained declustering. In: ACM ICS 2005, pp. 323–331 (2005)

    Google Scholar 

  19. Brinkmann, A., Effert, S., Meyer auf der Heide, F.: Dynamic and redundant data placement. In: ICDCS 2007, p. 29 (2007)

    Google Scholar 

  20. Gonzalez, J.L., Cortes, T.: Increasing the capacity of raid5 by online gradual assimilation. In: SNAPI 2004, pp. 17–24 (2004)

    Google Scholar 

  21. Gonzalez, J.L., Cortes, T.: Evaluating the effects of upgrading heterogeneous disk arrays. In: SPECTS 2006 (2006)

    Google Scholar 

  22. Labarta, J., Cortes, T.: Hraid: A flexible storage-system simulator. In: Proceedings of the International Conference on parallel and Distributed Processing Techniques and Applications, vol. 163, p. 772. CSREA Press (1999)

    Google Scholar 

  23. Franke, H., Gautam, N., Zhang, Y., Zhang, J., Sivasubramaniam, A., Nagar, S.: Synthesizing representative i/o workloads for tpc-h. In: HPCA, pp. 142–151 (2004)

    Google Scholar 

  24. Madhyastha, T.M., Hong, B., Zhang, B.: Cluster based input/output trace synthesis. In: IPCCC 2005 (2005)

    Google Scholar 

  25. OLTP Application I/O, http://traces.cs.umass.edu/index.php/storage/storage

Download references

Author information

Authors and Affiliations

  1. Department of Computer Architecture, Technical University of Catalonia(DAC-UPC), Spain

    J. L. Gonzalez

  2. Barcelona Supercomputing Center(BSC), Spain

    Toni Cortes

Authors
  1. J. L. Gonzalez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Toni Cortes
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. STARLab, Bldg G/10, Vrije Universiteit Brussel (VUB), Pleinlaan 2, 1050, Brussels, Belgium

    Robert Meersman

  2. School of Computer Science and Information Technology, Bld 10.10, RMIT University, 376-392 Swanston Street, VIC 3001, Melbourne, Australia

    Zahir Tari

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gonzalez, J.L., Cortes, T. (2008). Distributing Orthogonal Redundancy on Adaptive Disk Arrays. In: Meersman, R., Tari, Z. (eds) On the Move to Meaningful Internet Systems: OTM 2008. OTM 2008. Lecture Notes in Computer Science, vol 5331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88871-0_64

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-88871-0_64

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-88870-3

  • Online ISBN: 978-3-540-88871-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics