skip to main content
10.1145/1095810.1095828acmconferencesArticle/Chapter ViewAbstractPublication PagessospConference Proceedingsconference-collections
Article

Hibernator: helping disk arrays sleep through the winter

Published: 20 October 2005 Publication History

Abstract

Energy consumption has become an important issue in high-end data centers, and disk arrays are one of the largest energy consumers within them. Although several attempts have been made to improve disk array energy management, the existing solutions either provide little energy savings or significantly degrade performance for data center workloads.Our solution, Hibernator, is a disk array energy management system that provides improved energy savings while meeting performance goals. Hibernator combines a number of techniques to achieve this: the use of disks that can spin at different speeds, a coarse-grained approach for dynamically deciding which disks should spin at which speeds, efficient ways to migrate the right data to an appropriate-speed disk automatically, and automatic performance boosts if there is a risk that performance goals might not be met due to disk energy management.In this paper, we describe the Hibernator design, and present evaluations of it using both trace-driven simulations and a hybrid system comprised of a real database server (IBM DB2) and an emulated storage server with multi-speed disks. Our file-system and on-line transaction processing (OLTP) simulation results show that Hibernator can provide up to 65% energy savings while continuing to satisfy performance goals (6.5--26 times better than previous solutions). Our OLTP emulated system results show that Hibernator can save more energy (29%) than previous solutions, while still providing an OLTP transaction rate comparable to a RAID5 array with no energy management.

References

[1]
ILOG CPLEX 7.0 documentation home page. http://www.ise.ufl.edu/ilog/cplex70/.
[2]
Panel computer hard disk drive precautions. http://www.pro-face.com/support/technical/00apr3.htm.
[3]
Symmetrix 3000 and 5000 Enterprise Storage Systems product description guide. http://www.emc.com/, 1999.
[4]
Dell PowerEdge 6650 executive summary. http://www.tpc.org/results/individual_results/Dell/dell_6650_010603_es.pdf, Mar. 2003.
[5]
HP announces "smart" cooling solution for data centers. http://www.hp.com/hpinfo/newsroom/press/2003/030304b.html, March 4 2003.
[6]
HP Integrity RX5670 Cluster 64P Executive Summary. http://www.tpc.org/results/individual_results/HP/HP20Integrity20rx5670\20Cluster\2064P_ES.pdf, Dec. 2003.
[7]
D. H. Albonesi. Selective cache ways: on-demand cache resource allocation. In Proc. of the 32nd Annual International Symposium on Microarchitecture, 1999.
[8]
American Power Convension. Determining total cost of ownership for date centers and network room infrastructure. ftp://www.apcmedia.com/salestools/CMRP-5T9PQG_R2_EN.pdf, 2003.
[9]
E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: running circles around storage administration. In Proc. of the First USENIX Conference on File and Storage Technologies, Jan. 2002.
[10]
E. Carrera, E. Pinheiro, and R. Bianchini. Conserving disk energy in network servers. In Proc. of the 17th International Conference on Supercomputing, June 2003.
[11]
J. Chase and R. Doyle. Balance of power: energy management for server clusters. In Proc. of the 8th Workshop on Hot Topics in Operating Systems(HotOS), May 2001.
[12]
P. Chen, E. Lee, G. Gibson, R. Katz, and D. Patterson. RAID: high-performance, reliable secondary storage. ACM Computing Surveys, 26(2):145--185, 1994.
[13]
Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam. Managing server energy and operational costs in hosting centers. In Proc. of the International Conference on Measurement and Modeling of Computer Systems, June 2005.
[14]
D. Colarelli and D. Grunwald. Massive arrays of idle disks for storage archives. In Proceedings of the 2002 ACM/IEEE Conference on Supercomputing, pages 1--11, June 2002.
[15]
F. Douglis, P. Krishnan, and B. Bershad. Adaptive disk spindown policies for mobile computers. In Proc. of the 2nd USENIX Symposium on Mobile and Location Independent Computing, Apr. 1995.
[16]
G. Ganger, B. Worthington, and Y. Patt. The DiskSim simulation environment - version 2.0 reference manual. http://www.pdl.cmu.edu/DiskSim/disksim2.0.html.
[17]
C. Gniady, Y. C. Hu, and Y.-H. Lu. Program counter based techniques for dynamic power management. In Proc. of the 10th International Symposium on High Performance Computer Architecture, 2004.
[18]
R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. In Proc. of the USENIX Winter Technical Conference, Jan. 1995.
[19]
S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. DRPM: dynamic speed control for power management in server class disks. In Proc. of the 30th International Symposium on Computer Architecture, June 2003.
[20]
D. P. Helmbold, D. D. E. Long, T. L. Sconyers, and B. Sherrod. Adaptive disk spin-down for mobile computers. Mobile Networks and Applications, 5(4):285--297, 2000.
[21]
Ultrastar 36Z15 D atasheet. http://www.hitachigst.com/hdd/ultra/ul36z15.htm, Jan. 2003.
[22]
D. Li, P. Gu, H. Cai, and J. Wang. EERAID: energy-efficient redundant and inexpensive disk array. The 11th ACM SIGOPS European Workshop, Sept. 2004.
[23]
X. Li, Z. Li, F. David, P. Zhou, Y. Zhou, S. Adve, and S. Kumar. Performance directed energy management for main memory and disks. In Proc. of the 11th International Conference on Architectural Support for Programming Languages and Operating Systems, Oct. 2004.
[24]
C. Lumb, J. Schindler, G. Ganger, D. Nagle, and E. Riedel. Towards higher disk head utilization: Extracting "free" bandwidth from busy disk drives. In Proc. of the Fourth USENIX Symposium on Operating Systems Design and Implementation, Oct. 2000.
[25]
G. Magklis, M. L. Scott, G. Semeraro, D. H. Albonesi, and S. Dropsho. Profile-based dynamic voltage and frequency scaling for a multiple clock domain microprocessor. ACM SIGARCH Computer Architecture News, 31(2):14--27, 2003.
[26]
A. Merchant and P. S. Yu. Analytic modeling and comparisons of striping strategies for replicated disk arrays. IEEE Transactions on Computers, 44(3):419--33, 1995.
[27]
B. Moore. Take the data center power and cooling challenge. Energy User News, August 27 2002.
[28]
F. Moore. More power needed. Energy User News, 2002.
[29]
K. Okada, N. Kojima, and K. Yamashita. A novel drive architecture of HDD : multimode hard disc drive. In Proc. of the International Conference on Consumer Electronics, 2000.
[30]
A. E. Papathanasiou and M. L. Scott. Energy efficient prefetching and caching. In Proc. of the USENIX Annual Technical Conference, June 2004.
[31]
D. Patterson, G. Gibson, and R. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proc. of the ACM International Conference on Management of Data, 1988.
[32]
E. Pinheiro and R. Bianchini. Energy conservation techniques for disk array-based servers. In Proc. of the 18th International Conference on Supercomputing, June 2004.
[33]
P. Ranganathan. The power management challenge: Getting the next 100x. Keynote presentation at the 2nd workshop on optimizations for DSPs and Embedded Systems, March 12 2004.
[34]
C. Ruemmler and J. Wilkes. UNIX disk access patterns. In Proc. of the USENIX Winter Technical Conference, 1993.
[35]
S. Savage and J. Wilkes. AFRAID -- a frequently redundant array of independent disks. In USENIX Annual Technical Conference, pages 27--39, 1996.
[36]
E. Shriver, A. Merchant, and J. Wilkes. An analytic behavior model for disk drives with readahead caches and request reordering. In Proc. of the International Conference on Measurement and Modeling of Computer Systems, 1998.
[37]
S. W. Son, G. Chen, and M. Kandemir. Disk layout optimization for reducing energy consumption. In Proc. of the 19th International Conference on Supercomputing, June 2005.
[38]
G. Weikum, P. Zabback, and P. Scheuermann. Dynamic file allocation in disk arrays. In Proc. of the ACM International Conference on Management of Data, 1991.
[39]
A. Weissel, B. Beutel, and F. Bellosa. Cooperative I/O: a novel I/O semantics for energy-aware applications. In Proc. of the Fifth USENIX Symposium on Operating Systems Design and Implementation, Dec. 2002.
[40]
J. Wilkes, R. A. Golding, C. Staelin, and T. Sullivan. The HP AutoRAID hierarchical storage system. ACM Transactions on Computer Systems, 14(1):108--136, 1996.
[41]
E. Wusterenhoff. Service level agreement in the data center. http://www.sun.com/blueprints/0402/sla.pdf, Apr. 2002.
[42]
H. Yada, H. Ishioka, T. Yamakoshi, Y. Onuki, Y. Shimano, M. Uchida, H. Kanno, and N. Hayashi. Head positioning servo and data channel for HDD s with multiple spindle speeds. IEEE Transactions on Magnetics, 36(5):2213--2215, Sept. 2000.
[43]
Y. Zhou, A. Bilas, S. Jagannathan, C. Dubnicki, J. F. Philbin, and K. Li. Experiences with VI communication for database storage. In Proceedings of the 29th Annual International Symposium on Computer Architecture, pages 257--268, May 2002.
[44]
Q. Zhu and Y. Zhou. Power aware storage cache management. IEEE Transactions on Computers, 54(5):587--602, May 2005.

Cited By

View all
  • (2024)Streaming Algorithms with Few State ChangesProceedings of the ACM on Management of Data10.1145/36511452:2(1-28)Online publication date: 14-May-2024
  • (2024)Thesios: Synthesizing Accurate Counterfactual I/O Traces from I/O SamplesProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3620666.3651337(1016-1032)Online publication date: 27-Apr-2024
  • (2021)The Case for In-Memory OLAP on "Wimpy" Nodes2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00069(732-743)Online publication date: Apr-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SOSP '05: Proceedings of the twentieth ACM symposium on Operating systems principles
October 2005
259 pages
ISBN:1595930795
DOI:10.1145/1095810
  • cover image ACM SIGOPS Operating Systems Review
    ACM SIGOPS Operating Systems Review  Volume 39, Issue 5
    SOSP '05
    December 2005
    290 pages
    ISSN:0163-5980
    DOI:10.1145/1095809
    Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. disk array
  2. disk layout
  3. energy management
  4. performance guarantee
  5. storage system

Qualifiers

  • Article

Conference

SOSP05
Sponsor:

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25
ACM SIGOPS 31st Symposium on Operating Systems Principles
October 13 - 16, 2025
Seoul , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Streaming Algorithms with Few State ChangesProceedings of the ACM on Management of Data10.1145/36511452:2(1-28)Online publication date: 14-May-2024
  • (2024)Thesios: Synthesizing Accurate Counterfactual I/O Traces from I/O SamplesProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 310.1145/3620666.3651337(1016-1032)Online publication date: 27-Apr-2024
  • (2021)The Case for In-Memory OLAP on "Wimpy" Nodes2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00069(732-743)Online publication date: Apr-2021
  • (2021)Energy efficiency in cloud computing data center: a survey on hardware technologiesCluster Computing10.1007/s10586-021-03431-zOnline publication date: 21-Oct-2021
  • (2018)Energy efficiency and I/O performance of low‐power architecturesConcurrency and Computation: Practice and Experience10.1002/cpe.494831:18Online publication date: 30-Aug-2018
  • (2017)A reliable and energy-efficient storage system with erasure coding cacheFrontiers of Information Technology & Electronic Engineering10.1631/FITEE.160097218:9(1370-1384)Online publication date: 27-Oct-2017
  • (2017)Towards energy-efficient storage serversProceedings of the Symposium on Applied Computing10.1145/3019612.3019742(1554-1559)Online publication date: 3-Apr-2017
  • (2017)Autonomic Cross-Layer Management of Cloud Systems2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS*W)10.1109/FAS-W.2017.141(160-165)Online publication date: Sep-2017
  • (2017)Employing dual-block correlations to reduce the energy consumption of disk drivesComputing10.1007/s00607-016-0488-799:3(235-253)Online publication date: 1-Mar-2017
  • (2016)PCAPProceedings of the 14th Usenix Conference on File and Storage Technologies10.5555/2930583.2930600(227-240)Online publication date: 22-Feb-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media