Skip to main content

Advertisement

Log in

HAG: An Energy-Proportional Data Storage Scheme for Disk Array Systems

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Energy consumption has been a critical issue for data storage systems, especially for modern data centers. A recent survey has showed that power costs amount to about 50% of the total cost of ownership in a typical data center, with about 27% of the system power being consumed by storage systems. This paper aims at providing an effective solution to reducing the energy consumed by disk storage systems, by proposing a new approach to reduce the energy consumption. Differing from previous approaches, we adopt two new designs. 1) We introduce a hotness-aware and group-based system model (HAG) to organize the disks, in which all disks are partitioned into a hot group and a cold group. We only make file migration between the two groups and avoid the migration within a single group, so that we are able to reduce the total cost of file migration. 2) We use an on-demand approach to reorganize files among the disks that is based on workload change as well as the change of data hotness. We conduct trace-driven experiments involving two real and nine synthetic traces and we make detailed comparisons between our method and competitor methods according to different metrics. The results show that our method can dynamically select hot files and disks when the workload changes and that it is able to reduce energy consumption for all the traces. Furthermore, its time performance is comparable to that of the compared algorithms. In general, our method exhibits the best energy efficiency in all experiments, and it is capable of maintaining an improved trade-off between performance and energy consumption.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Joukov N, Sipek J. GreenFS: Making enterprise computers greener by protecting them better. In Proc. EuroSys, April 2008, pp.69-80.

  2. Weddle C, Oldham M, Qian J, Wang A A, Reiher P, Kuenning G H. PARAID: A gear-shifting power-aware RAID. ACM Transaction on Storage, 2007, 3(3): Article No. 13.

  3. Jin Y, Xing B, Jin P. Towards a benchmark platform for measuring the energy consumption of database systems. Advanced Science and Technology Letters, 2013, 29: 385-389.

    Google Scholar 

  4. Bostoen T, Mullender S J, Berbers Y. Power-reduction techniques for data-center storage systems. ACM Computing Surveys, 2013, 45(3): 33:1-33:38.

  5. Kim J, Rotem D. Energy proportionality for disk storage using replication. In Proc. the 14th EDBT, March 2011, pp.81-92.

  6. Kim J, Rotem D. FREP: Energy proportionality for disk storage using replication. Journal of Parallel and Distributed Computing, 2012, 72(8): 960-974.

    Article  Google Scholar 

  7. Verma A, Koller R, Useche L, Rangaswami R. SRCMap: Energy proportional storage using dynamic consolidation. In Proc. the 8th FAST, February 2010, pp.267-280.

  8. Colarelli D, Grunwald D. Massive arrays of idle disks for storage archives. In Proc. the ACM/IEEE SC, November 2002, pp.1-11.

  9. Useche L, Guerra J, Bhadkamkar M, Alarcon M, Rangaswami R. EXCES: External caching in energy saving storage systems. In Proc. the 14th HPCA, Feb. 2008, pp.89-100.

  10. Thereska E, Donnelly A, Narayanan D. Sierra: Practical power-proportionality for data center storage. In Proc. the 6th EuroSys, April 2011, pp.169-182.

  11. Hui J, Ge X, Huang X, Liu Y, Ran Q. E-HASH: An energyefficient hybrid storage system composed of one SSD and multiple HDDs. In Proc. the 3rd ICSI, June 2012, pp.527-534.

  12. Pinheiro E, Bianchini R. Energy conservation techniques for disk array-based servers. In Proc. the 18th ICS, June 26-July 1, 2004, pp.68-78.

  13. Otoo E J, Rotem D, Tsao S C. Dynamic data reorganization for energy savings in disk storage systems. In Proc. the 22nd SSDBM, June 30-July 2, 2010, pp.322-341.

  14. Irani S, Singh G, Shukla S K, Gupta R K. An overview of the competitive and adversarial approaches to designing dynamic power management strategies. IEEE Transactions on Very Large Scale Integration Systems, 2005, 13(12): 1349-1361.

    Article  Google Scholar 

  15. Irani S, Gupta R K, Shukla S K. Competitive analysis of dynamic power management strategies for systems with multiple power savings states. In Proc. DATE, March 2002, pp.117-123.

  16. Padmanabhan V N, Qiu L. The content and access dynamics of a busy web site: Findings and implications. In Proc. SIGCOMM, August 28-September 1, 2000, pp.111-123.

  17. Zhu Q, Chen Z, Tan L, Zhou Y, Keeton K, Wilkes J. Hibernator: Helping disk arrays sleep through the winter. In Proc. the 20th SOSP, October 2005, pp.177-190.

  18. Otoo E J, Rotem D, Tsao S C. Energy smart management of scientific data. In Proc. the 21st SSDBM, June 2009, pp.92-109.

  19. Chen Y, Ganapathi A S, Fox A, Katz R H, Patterson D A. Statistical workloads for energy efficient MapReduce. Technical Report, No. UCB/EECS-2010-6, EECS Department, University of California at Berkeley, January 2010.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xike Xie.

Additional information

The work was partially supported by the National Natural Science Foundation of China under Grant Nos. 61379037 and 61472376, and the Oversea Academic Training Funds (OATF) sponsored by the University of Science and Technology of China.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, PQ., Xie, X., Jensen, C.S. et al. HAG: An Energy-Proportional Data Storage Scheme for Disk Array Systems. J. Comput. Sci. Technol. 30, 679–695 (2015). https://doi.org/10.1007/s11390-015-1554-x

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-015-1554-x

Keywords

Navigation