Skip to main content

Advertisement

SpringerLink
Log in

FAIRIO: A Throughput-oriented Algorithm for Differentiated I/O Performance

  • Published:
International Journal of Parallel Programming Aims and scope Submit manuscript

Abstract

Providing differentiated service in a consolidated storage environment is a challenging task. To address this problem, we introduce FAIRIO, a cycle-based I/O scheduling algorithm that provides differentiated service to workloads concurrently accessing a consolidated RAID storage system. FAIRIO enforces proportional sharing of I/O service through fair scheduling of disk time. During each cycle of the algorithm, I/O requests are scheduled according to workload weights and disk-time utilization history. Experiments, which were driven by the I/O request streams of real and synthetic I/O benchmarks and run on a modified version of DiskSim, provide evidence of FAIRIO’s effectiveness and demonstrate that fair scheduling of disk time is key to achieving differentiated service in a RAID storage system. In particular, the experimental results show that, for a broad range of workload request types, sizes, and access characteristics, the algorithm provides differentiated storage throughput that is within 10% of being perfectly proportional to workload weights; and, it achieves this with little or no degradation of aggregate throughput. The core design concepts of FAIRIO, including service-time allocation and history-driven compensation, potentially can be used to design I/O scheduling algorithms that provide workloads with differentiated service in storage systems comprised of RAIDs, multiple RAIDs, SANs, and hypervisors for Clouds.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Arunagiri, S., Kwok, Y., Teller, P.J., Portillo, R., Seelam, S.R.: FAIRIO: an algorithm for differentiated I/O performance. In: SBAC-PAD ’11: Proceedings of the 23rd International Symposium on Computer Architecture and High Performance Computing (2011)

  2. Bucy, J.S., Ganger, G.R., Contributors: The DiskSim simulation environment version 3.0 reference manual. Technical Report CMU-CS-03-102, School of Computer Science, Carnegie Mellon University (2003)

  3. Chambliss, D., Alvarez, G., Pandey, P., Jadav, D., Xu, J., Menon, R., Lee, T.: Performance virtualization for large-scale storage systems. In: SRDS ’03: Proceedings of the 22nd International Symposium on Reliable Distributed Systems, pp. 109–118 (2003). doi:10.1109/RELDIS.2003.1238060

  4. Department of Energy: Scientific grand challenges, architecture and technology for extreme scale computing (2009). http://science.energy.gov/~/media/ascr/pdf/program-documents/docs/Arch_tech_grand_challenges_report.pdf

  5. Gulati, A., Ahmad, I., Waldspurger, C.A.: PARDA: proportional allocation of resources for distributed storage access. In: FAST ’09: Proceedings of the 7th Conference on File and Storage Technologies, pp. 85–98. USENIX Association, Berkeley, CA, USA (2009)

  6. Gulati, A., Merchant, A., Varman, P.J.: mClock: handling throughput variability for hypervisor IO scheduling. In: Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation, OSDI’10, pp. 1–7. USENIX Association, Berkeley, CA, USA (2010). http://dl.acm.org/citation.cfm?id=1924943.1924974

  7. Jin W., Chase J., Kaur J.: Interposed proportional sharing for a storage service utility. SIGMETRICS Perform. Eval. Rev. 32(1), 37–48 (2004). doi:10.1145/1012888.1005694

    Article  Google Scholar 

  8. Juve, G., Deelman, E., Vahi, K., Mehta, G., Berriman, B., Berman, B., Maechling, P.: Scientific workflow applications on Amazon EC2. In: 5th IEEE International Conference on E-Science Workshops, pp. 59–66 (2009). doi:10.1109/ESCIW.2009.5408002

  9. Kaldewey, T., Wong, T., Golding, R., Povzner, A., Brandt, S., Maltzahn, C.: Virtualizing disk performance. In: RTAS ’08: Proceedings of the 2008 IEEE Real-Time and Embedded Technology and Applications Symposium, pp. 319–330 (2008). doi:10.1109/RTAS.2008.31

  10. Karlsson M., Karamanolis C., Zhu X.: Triage: performance differentiation for storage systems using adaptive control. Trans. Storage 1(4), 457–480 (2005). doi:10.1145/1111609.1111612

    Article  Google Scholar 

  11. Lumb, C., Merchant, A., Alvarez, G.: Façade: virtual storage devices with performance guarantees. In: FAST ’03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies, pp. 131–144. USENIX Association, Berkeley, CA, USA (2003)

  12. Merchant, A., Uysal, M., Padala, P., Zhu, X., Singhal, S., Shin, K.: Maestro: quality-of-service in large disk arrays. In: ICAC ’11: Proceedings of the 8th ACM International Conference on Autonomic Computing, pp. 245–254. ACM, New York, NY, USA (2011)

  13. Park S.M., Humphrey M.: Predictable high-performance computing using feedback control and admission control. IEEE Trans. Parallel Distrib. Syst. 22(3), 396–411 (2011). doi:10.1109/TPDS.2010.100

    Article  Google Scholar 

  14. Povzner A., Kaldewey T., Brandt S., Golding R., Wong T., Maltzahn C.: Efficient guaranteed disk request scheduling with fahrrad. SIGOPS Oper. Syst. Rev. 42(4), 13–25 (2008). doi:10.1145/1357010.1352595

    Article  Google Scholar 

  15. Prabhakar, R., Vazhkudai, S., Kim, Y., Butt, A., Li, M., Kandemir, M.: Provisioning a multi-tiered data staging area for extreme-scale machines. In: ICDCS ’11: Proceedings of the 31st International Conference on Distributed Computing Systems, pp. 1–12 (2011). doi:10.1109/ICDCS.2011.33

  16. Ramakrishnan, L., Jackson, K.R., Canon, S., Cholia, S., Shalf, J.: Defining future platform requirements for e-Science clouds. In: SoCC ’10: Proceedings of the 1st ACM Symposium on Cloud Computing, pp. 101–106. ACM, New York, NY, USA (2010). doi:10.1145/1807128.1807145

  17. Seelam, S.R.: Towards dynamic adaptation of I/O scheduling in commodity operating systems. Ph.D. thesis, The University of Texas at El Paso. Advisor-Teller, Patricia J. (2006)

  18. Shafer, J.: A storage architecture for data-intensive computing. Ph.D. thesis, Rice University. Advisor-Rixner, Scott (2010)

  19. Shenoy, P., Vin, H.: Cello: a disk scheduling framework for next generation operating systems. Technical Report TR-97-27, University of Texas at Austin (1998)

  20. Verghese B., Gupta A., Rosenblum M.: Performance isolation: sharing and isolation in shared-memory multiprocessors. SIGOPS Oper. Syst. Rev. 32, 181–192 (1998). doi:10.1145/384265.291044

    Article  Google Scholar 

  21. Wachs, M., Abd-El-Malek, M., Thereska, E., Ganger, G.R.: Argon: performance insulation for shared storage servers. In: FAST ’07: Proceedings of the 5th USENIX Conference on File and Storage Technologies, pp. 5–5. USENIX Association, Berkeley, CA, USA (2007). http://dl.acm.org/citation.cfm?id=1267903.1267908

  22. Wijayaratne R., Reddy A.: Providing QoS guarantees for disk I/O. Multimedia Syst. 8(1), 57–68 (2000). doi:10.1007/s005300050005

    Article  Google Scholar 

  23. Wong, T., Golding, R., Lin, C., Becker-Szendy, R.: Zygaria: Storage performance as a managed resource. In: RTAS ’06: Proceedings of the 12th IEEE Real-Time and Embedded Technology and Applications Symposium, pp. 125–134 (2006). doi:10.1109/RTAS.2006.46

  24. Wu, J.C., Brandt, S.A.: The design and implementation of AQuA: an adaptive quality of service aware object-based storage device. In: MSST ’06: Proceedings of the 23rd IEEE/14th NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 209–218. College Park, MD (2006)

  25. Zhang, J., Riska, A., Sivasubramaniam, A., Wang, Q., Riedel, E.: Storage performance virtualization via throughput and latency control. In: 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2005, pp. 135–142 (2005). doi:10.1109/MASCOTS.2005.70

  26. Zhang J., Sivasubramaniam A., Wang Q., Riska A., Riedel E.: Storage performance virtualization via throughput and latency control. Trans. Storage 2(3), 283–308 (2006). doi:10.1145/1168910.1168913

    Article  Google Scholar 

  27. Zhang, X., Davis, K., Jiang, S.: QoS support for end users of I/O-intensive applications using shared storage systems. In: SC ’11: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, pp. 18:1–18:12. ACM, New York, NY, USA (2011). doi:10.1145/2063384.2063408.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, The University of Texas at El Paso, Computer Science Building, 500 West University Avenue, El Paso, TX, 79968, USA

    Sarala Arunagiri, Yipkei Kwok, Patricia J. Teller & Ricardo A. Portillo

  2. IBM T. J. Watson Research Center, 1101 Kitchawan Road, Yorktown Heights, NY, 10598, USA

    Seetharami R. Seelam

Authors
  1. Sarala Arunagiri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yipkei Kwok
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patricia J. Teller
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ricardo A. Portillo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Seetharami R. Seelam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sarala Arunagiri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arunagiri, S., Kwok, Y., Teller, P.J. et al. FAIRIO: A Throughput-oriented Algorithm for Differentiated I/O Performance. Int J Parallel Prog 42, 165–197 (2014). https://doi.org/10.1007/s10766-012-0217-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10766-012-0217-6

Keywords

Search

Navigation