research-article

Busy bee: how to use traffic information for better scheduling of background tasks

Authors:

Evgenia SmirniAuthors Info & Claims

ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

Pages 145 - 156

https://doi.org/10.1145/2188286.2188308

Published: 22 April 2012 Publication History

Abstract

Computer systems, in general, and storage systems, in particular, rely on meeting their performance, reliability, and availability targets via scheduling of management and maintenance activities as background tasks.Such tasks may cause significant delays to user workload if scheduled extemporaneously. Here, we propose a scheduling policy for background tasks that is based on the statistical characteristics of the system's busy periods and that aims at completing background work expediently.Extensive trace-driven simulations show that the scheduling policy is robust and that it succeeds in completing background work faster than common practices while impacting user performance minimally.

References

[1]

E. Bachmat and J. Schindler. Analysis of methods for scheduling low priority disk drive tasks. In SIGMETRICS, pages 55--65, 2002.

Digital Library

[2]

L. N. Bairavasundaram, G. R. Goodson, S. Pasupathy, and J. Schindler. An analysis of latent sector errors in disk drives. In SIGMETRICS, pages 289--300, 2007.

Digital Library

[3]

J. L. Bruno, J. C. Brustoloni, E. Gabber, B. Özden, and A. Silberschatz. Disk scheduling with quality of service guarantees. In ICMCS, Vol. 2, pages 400--405, 1999.

Digital Library

[4]

F. Douglis and P. Krishnan. Adaptive disk spin-down policies for mobile computers. Computing Systems, 8(4):381--413, 1995.

[5]

L. Eggert and J. D. Touch. Idletime scheduling with preemption intervals. In SOSP, pages 249--262, 2005.

Digital Library

[6]

S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. In SOSP, pages 29--43, 2003.

Digital Library

[7]

R. A. Golding, P. B. II, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. In USENIX Winter, pages 201--212, 1995.

Digital Library

[8]

J. Guerra, H. Pucha, J. S. Glider, W. Belluomini, and R. Rangaswami. Cost effective storage using extent based dynamic tiering. In FAST, pages 273--286, 2011.

Digital Library

[9]

A. Gulati, A. Merchant, and P. J. Varman. pclock: an arrival curve based approach for qos guarantees in shared storage systems. In SIGMETRICS, pages 13--24, 2007.

Digital Library

[10]

D. P. Helmbold, D. D. E. Long, T. L. Sconyers, and B. Sherrod. Adaptive disk spin-down for mobile computers. MONET, 5(4):285--297, 2000.

Digital Library

[11]

H. Huang, W. Hung, and K. G. Shin. Fs2: dynamic data replication in free disk space for improving disk performance and energy consumption. In SOSP, pages 263--276, 2005.

Digital Library

[12]

I. Iliadis, R. Haas, X.-Y. Hu, and E. Eleftheriou. Disk scrubbing versus intra-disk redundancy for high-reliability raid storage systems. In SIGMETRICS, pages 241--252, 2008.

Digital Library

[13]

C. R. Lumb, A. Merchant, and G. A. Alvarez. Façade: Virtual storage devices with performance guarantees. In FAST, pages 131--144, 2003.

Digital Library

[14]

M. K. McKusick and G. R. Ganger. Soft updates: A technique for eliminating most synchronous writes in the fast filesystem. In USENIX Annual Technical Conference, FREENIX Track, pages 1--17, 1999.

Digital Library

[15]

N. Mi, A. Riska, X. Li, E. Smirni, and E. Riedel. Restrained utilization of idleness for transparent scheduling of background tasks. In SIGMETRICS/Performance, pages 205--216, 2009.

Digital Library

[16]

N. Mi, A. Riska, Q. Zhang, E. Smirni, and E. Riedel. Efficient management of idleness in storage systems. TOS, 5(2), 2009.

Digital Library

[17]

J. S. Plank, J. Luo, C. D. Schuman, L. Xu, and Z. Wilcox-O'Hearn. A performance evaluation and examination of open-source erasure coding libraries for storage. In FAST, pages 253--265, 2009.

Digital Library

[18]

A. Riska and E. Riedel. Disk drive level workload characterization. In USENIX Annual Technical Conference, General Track, pages 97--102, 2006.

Digital Library

[19]

M. I. Seltzer, G. R. Ganger, M. K. McKusick, K. A. Smith, C. A. N. Soules, and C. A. Stein. Journaling versus soft updates: Asynchronous meta-data protection in file systems. In USENIX Annual Technical Conference, General Track, pages 71--84, 2000.

Digital Library

[20]

M. Sivathanu, V. Prabhakaran, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Improving storage system availability with d-graid. TOS, 1(2):133--170, 2005.

Digital Library

[21]

E. Thereska, J. Schindler, J. S. Bucy, B. Salmon, C. R. Lumb, and G. R. Ganger. A framework for building unobtrusive disk maintenance applications. In FAST, pages 213--226, 2004.

Digital Library

[22]

W. Vogels. Eventually consistent. ACM Queue, 6(6):14--19, 2008.

Digital Library

[23]

M. Wachs and G. R. Ganger. Co-scheduling of disk head time in cluster-based storage. In SRDS, pages 278--287, 2009.

Digital Library

[24]

F. Yan, X. Mountrouidou, A. Riska, and E. Smirni. Copy rate synchronization with performance guarantees for work consolidation in storage clusters. In GreenMetrics 2011 Workshop, San Jose, CA, USA, 2011.

Digital Library

Cited By

Kachmar MKaeli D(2020)A Smart Background Scheduler for Storage Systems2020 28th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)10.1109/MASCOTS50786.2020.9285967(1-8)Online publication date: 17-Nov-2020
https://doi.org/10.1109/MASCOTS50786.2020.9285967
Yan FSmirni E(2016)Workload interleaving with performance guarantees in data centersNOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS.2016.7502934(967-972)Online publication date: Apr-2016
https://doi.org/10.1109/NOMS.2016.7502934
Xue JYan FRiska ASmirni E(2016)Scheduling data analytics work with performance guaranteesCluster Computing10.1007/s10586-016-0563-z19:2(849-864)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s10586-016-0563-z
Show More Cited By

Index Terms

Busy bee: how to use traffic information for better scheduling of background tasks

Recommendations

Efficient management of idleness in storage systems

Various activities that intend to enhance performance, reliability, and availability of storage systems are scheduled with low priority and served during idle times. Under such conditions, idleness becomes a valuable “resource” that needs to be ...
HPDA: A hybrid parity-based disk array for enhanced performance and reliability

Flash-based Solid State Drive (SSD) has been productively shipped and deployed in large scale storage systems. However, a single flash-based SSD cannot satisfy the capacity, performance and reliability requirements of the modern storage systems that ...
RAPID-Cache-A Reliable and Inexpensive Write Cache for High Performance Storage Systems

Modern high performance disk systems make extensive use of nonvolatile RAM (NVRAM) write caches. A single-copy NVRAM cache creates a single point of failure while a dual-copy NVRAM cache is very expensive because of the high cost of NVRAM. This paper ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

April 2012

362 pages

ISBN:9781450312028

DOI:10.1145/2188286

General Chairs:
David Kaeli
Northeastern University, USA
,
Jerry Rolia
Hewlett Packard Labs, USA
,
Program Chairs:
Lizy John
University of Texas at Austin, USA
,
Diwakar Krishnamurthy
University of Calgary, Canada

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGSOFT: ACM Special Interest Group on Software Engineering
SPEC: SPEC Research Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICPE'12

Sponsor:

ICPE'12: Third Joint WOSP/SIPEW International Conference on Performance Engineering

April 22 - 25, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
116
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kachmar MKaeli D(2020)A Smart Background Scheduler for Storage Systems2020 28th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)10.1109/MASCOTS50786.2020.9285967(1-8)Online publication date: 17-Nov-2020
https://doi.org/10.1109/MASCOTS50786.2020.9285967
Yan FSmirni E(2016)Workload interleaving with performance guarantees in data centersNOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS.2016.7502934(967-972)Online publication date: Apr-2016
https://doi.org/10.1109/NOMS.2016.7502934
Xue JYan FRiska ASmirni E(2016)Scheduling data analytics work with performance guaranteesCluster Computing10.1007/s10586-016-0563-z19:2(849-864)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s10586-016-0563-z
Xue JYan FRiska ASmirni E(2015)Proactive Management of Systems via Hybrid Analytic TechniquesProceedings of the 2015 International Conference on Cloud and Autonomic Computing10.1109/ICCAC.2015.31(137-148)Online publication date: 21-Sep-2015
https://dl.acm.org/doi/10.1109/ICCAC.2015.31
Daci GBezhani A(2012)A Review of Disc Scrubbing and Intra Disk Redundancy for Reducing Data Loss in Disk FileSystemsProceedings of the Third International Conference on Trends in Information, Telecommunication and Computing10.1007/978-1-4614-3363-7_69(585-589)Online publication date: 11-Sep-2012
https://doi.org/10.1007/978-1-4614-3363-7_69

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten