Skip to main content
Springer Nature Link
Log in

Energy Smart Management of Scientific Data

  • Conference paper
Scientific and Statistical Database Management (SSDBM 2009)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5566))

  • 1445 Accesses

Abstract

Scientific data centers comprised of high-powered computing equipment and large capacity disk storage systems consume considerable amount of energy. Dynamic power management techniques (DPM) are commonly used for saving energy in disk systems. These involve powering down disks that exhibit long idle periods and placing them in standby mode. A file request from a disk in standby mode will incur both energy and performance penalties as it takes energy (and time) to spin up the disk before it can serve a file. For this reason, DPM has to make decisions as to when to transition the disk into standby mode such that the energy saved is greater than the energy needed to spin it up again and the performance penalty is tolerable. The length of the idle period until the DPM decides to power down a disk is called idleness threshold.

In this paper, we study both analytically and experimentally dynamic power management techniques that save energy subject to performance constraints on file access costs. Based on observed workloads of scientific applications and disk characteristics, we provide a methodology for determining file assignment to disks and computing idleness thresholds that result in significant improvements to the energy saved by existing DPM solutions while meeting response time constraints. We validate our methods with simulations that use traces taken from scientific applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Barroso, L.A.: The price of performance. Queue 3(7), 48–53 (2005)

    Article  Google Scholar 

  2. Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., Franke, H.: Reducing disk power consumption in servers with drpm. Computer 36(12), 59–66 (2003)

    Article  Google Scholar 

  3. Seagate: Seagate Barracuda 7200.10 Serial ATA Product Manual. Seagate Technology, Scotts Valley, CA (December 2007)

    Google Scholar 

  4. Colarelli, D., Grunwald, D.: Massive arrays of idle disks for storage archives. In: Supercomputing 2002: Proc. ACM/IEEE Conference on Supercomputing, pp. 1–11. IEEE Computer Society Press, Los Alamitos (2002)

    Google Scholar 

  5. Weddle, C., Oldham, M., Qian, J., Wang, A.: PARAID: A gear shifting power-aware RAID. ACM Trans. on Storage (TOS) 3(3), 26–28 (2007)

    Google Scholar 

  6. Storer, M.W., Greenan, K.M., Miller, E.L.: Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage. In: Proc. 6th USENIX Conf. on File and Storage Technologies (FAST 2008), San Jose, California, pp. 1–16 (Feburary 2008)

    Google Scholar 

  7. Xie, T.: Sea: A striping-based energy-aware strategy for data placement in RAID-structured storage system. IEEE Transactions on Computers 57(6), 748–769 (2008)

    Article  MathSciNet  Google Scholar 

  8. Irani, S., Singh, G., Shukla, S.K., Gupta, R.K.: An overview of the competitive and adversarial approaches to designing dynamic power management strategies. IEEE Trans. VLSI Syst. 13(12), 1349–1361 (2005)

    Article  Google Scholar 

  9. Narayanan, D., Donnelly, A., Rowstron, A.: Write off-loading: Practical power management for enterprise storage. In: Proc. 6th USENIX Conf. on File and Storage Technologies (FAST 2008), San Jose, California, pp. 253–267 (Feburary 2008)

    Google Scholar 

  10. Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., Wilkes, J.: Hibernator: Helping disk arrays sleep through the winter. In: SOSP 2005: Proc. 20th ACM Symp. on Operating Syst. Principles, pp. 177–190. ACM Press, New York (2005)

    Google Scholar 

  11. Pinheiro, E., Bianchini, R.: Energy conservation techniques for disk array-based servers. In: Proc. Int’l. Conf. on Supercomputing (ICS 2004), Saint-Malo, France, June 26 (2004)

    Google Scholar 

  12. Guha, A.: Data archiving using enhanced maid (massive array of idle disks), May 15-18 (2006)

    Google Scholar 

  13. Guha, A.: A new approach to disk-based mass storage systems. In: 12th NASA Goddard - 21st IEEE Conf. on Mass Storage Syst. and Tech., College Park, Maryland (2004)

    Google Scholar 

  14. Karlin, A.R., Manasse, M.S., McGeoch, L.A., Owicki, S.: Competitive randomized algorithms for non-uniform problems. In: SODA 1990: Proceedings of the first annual ACM-SIAM symposium on Discrete algorithms, pp. 301–309. Society for Industrial and Applied Mathematics, Philadelphia (1990)

    Google Scholar 

  15. Irani, S., Gupta, R., Shukla, S.: Competitive analysis of dynamic power management strategies for systems with multiple power savings states. In: DATE 2002: Proceedings of the conference on Design, automation and test in Europe, p. 117. IEEE Computer Society, Washington (2002)

    Chapter  Google Scholar 

  16. Ramanathan, D., Irani, S., Gupta, R.: Latency effects of system level power management algorithms. In: ICCAD 2000: Proceedings of the 2000 IEEE/ACM international conference on Computer-aided design, pp. 350–356. IEEE Press, Piscataway (2000)

    Google Scholar 

  17. Rivoire, S., Shah, M.A., Ranganathan, P., Kozyrakis, C.: Joulesort: a balanced energy-efficiency benchmark. In: SIGMOD 2007: Proceedings of the 2007 ACM SIGMOD international conference on Management of data, pp. 365–376. ACM, New York (2007)

    Chapter  Google Scholar 

  18. Poess, M., Nambiar, R.O.: Energy cost, the key challenge of today’s data centers: a power consumption analysis of tpc-c results. Proc. VLDB Endow. 1(2), 1229–1240 (2008)

    Article  Google Scholar 

  19. Lu, L., Varman, P.: Workload decomposition for power efficient storage systems. In: Proc. Workshop on Power Aware Computing and Systems (HotPower 2008), San Diego, CA, USA (December 2008)

    Google Scholar 

  20. Harizopoulos, S., Shah, J.M.M.A., Ranganathan, P.: The new holy grail of data management systems research. In: CIDR 2009: Proc. of the 4th Biennial Conf. on Innovative Data Syst. Research. ACM, New York (2009)

    Google Scholar 

  21. Lang, W., Patel, J.M.: Towards ecofriendly database management systems. In: CIDR 2009: Proc. of the 4th Biennial Conf. on Innovative Data Syst. Research. ACM, New York (2009)

    Google Scholar 

  22. Bisson, T., Brandt, S.A., Long, D.D.E.: A hybrid disk-aware spin-down algorithm with I/O subsystem support. In: Proc. Perf., Comput., and Com. Conf. (IPCCC 2007), New Orleans, LA, pp. 236–245 (May 2007)

    Google Scholar 

  23. Lee, L.W., Scheuermann, P., Vingralek, R.: File assignment in parallel I/O systems with minimal variance of service time. IEEE Transactions on Computers 49(2), 127–140 (2000)

    Article  Google Scholar 

  24. SourceForge .net: SimPy Simulation Package in Python, http://simpy.sourceforge.net/archive.htm

  25. Zedlewski, J., Sobti, S., Garg, N., Zheng, F., Krishnamurthy, A., Wang, R.: Modeling hard-disk power consumption. In: FAST 2003: Proc. 2nd USENIX Conf. on File and Storage Tech., Berkeley, CA, USA, pp. 217–230. USENIX Association (2003)

    Google Scholar 

  26. Cunha, C., Bestavros, A., Crovella, M.: Characteristics of www client-based traces. Technical report, Boston University, Boston, MA, USA (1995)

    Google Scholar 

  27. Bucy, J., Schindler, J., Schlosser, S., Ganger, G.: The disksim simulation environment

    Google Scholar 

  28. BaBar: The babar collaboration, http://www.slac.stanford.edu/bfroot/

Download references

Author information

Authors and Affiliations

  1. Lawrence Berkeley National Laboratory, University of California, 1 Cyclotron Road, Berkeley, CA 94720, USA

    Ekow Otoo, Doron Rotem & Shih-Chiang Tsao

Authors
  1. Ekow Otoo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Doron Rotem
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shih-Chiang Tsao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of Illinois at Urbana-Champaign, 201 N. Goodwin Avenue, IL 61801, Urbana, USA

    Marianne Winslett

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Otoo, E., Rotem, D., Tsao, SC. (2009). Energy Smart Management of Scientific Data. In: Winslett, M. (eds) Scientific and Statistical Database Management. SSDBM 2009. Lecture Notes in Computer Science, vol 5566. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02279-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-02279-1_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-02278-4

  • Online ISBN: 978-3-642-02279-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics