Skip to main content
SpringerLink
Log in
Book cover

Australian Symposium on Service Research and Innovation

ASSRI 2013: Service Research and Innovation pp 59–73Cite as

Smart CloudBench - Test Drive the Cloud Before You Buy

  • Conference paper
  • First Online:

  • 581 Accesses

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 177))

Abstract

In recent years there has been an exponential growth in the number of vendors offering Infrastructure-as-a-Service (IaaS), with a corresponding increase in the number of enterprises looking to migrate some, or all of their IT systems to the cloud. Prospective cloud consumers need to identify providers that offer resources with the most appropriate pricing and performance levels to match their specific business needs before making any migration decisions. However, no two vendors offer the same resource configurations, pricing models or provisioning models. Moreover, cloud vendors tend to use different virtualization techniques which impact the performance of the software systems running on top of their infrastructure. Since consumers only have a black-box view of the cloud, it makes the task of comparing and selecting appropriate computing resources a very complex exercise. In this paper, we present Smart CloudBench, which is a suite of software tools that allows prospective cloud consumers to test drive the cloud and make purchasing decisions based on price, specification AND performance. Cloud consumers can use Smart CloudBench for the automated, on-demand, real-time and customized benchmarking of cloud infrastructure and use the benchmarking results along with the pricing and specification information to make more informed purchasing decisions. Tests using Smart CloudBench show that the performance of higher priced servers is not necessarily better than that of lower priced ones, and it has to be tested extensively in order to substitute assumptions with facts.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Some example representative applications include TPC-W for a transactional e-commerce web application [5] and Media Streaming benchmark application for media streaming applications such as Netflix or Yuku [6].

  2. 2.

    www.smartcloudbroker.com

  3. 3.

    Source code is available for both the TPC-W benchmark server implementation as well as the client implementation (TA) is available online at http://www.cs.virginia.edu/th8k/downloads/.

  4. 4.

    http://cloudharmony.com/benchmarks

  5. 5.

    http://www.cloudspectator.com/

  6. 6.

    http://serverbear.com/

  7. 7.

    http://www.cedexis.com/products/radar.html

References

  1. Baruwal Chhetri, M., Vo, Q.B., Kowalczyk, R., Lan Do, C.: Cloud broker: helping you buy better. In: Bouguettaya, A., Hauswirth, M., Liu, L. (eds.) WISE 2011. LNCS, vol. 6997, pp. 341–342. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  2. Baruwal Chhetri, M., Chichin, S., Vo, Q.B., Kowalczyk, R.: Smart CloudBench: automated performance benchmarking of the cloud. In: Proceedings of CLOUD 2013, 27 June–2 July 2013, California (2013)

    Google Scholar 

  3. Baruwal Chhetri, M., Vo, Q.B., Kowalczyk, R.: Policy-based automation of SLA establishment for cloud computing services. In: Proceedings of the 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID-12), Ottawa (Canada), 13–16 May 2012

    Google Scholar 

  4. Baruwal Chhetri, M., Vo, Q.B., Kowalczyk, R.: AutoSLAM - a policy-driven middleware for automated SLA establishment in SOA environments. In: Proceedings of the 9th International Conference on Service Computing (SCC 2012), Honolulu, Hawaii, USA, pp. 9–16. IEEE (2012)

    Google Scholar 

  5. Transaction Processing Performance Council. TPC Benchmark W (Web Commerce) Specification, version 2.0r. Technical Specification (2003). http://www.tpc.org/tpcw/spec/TPCWV2.pdf

  6. Ferdman, M., et al.: Clearing the clouds: a study of emerging scale-out workloads on modern hardware. In: The 17th International Conference on Architectural Support for Programming Languages and Operating Systems (2012)

    Google Scholar 

  7. Iosup, A., Prodan, R., Epema, D.: IaaS cloud benchmarking: approaches, challenges, and experience. In: Proceedings of 5th Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS) (2012)

    Google Scholar 

  8. Li, A., Yang, X., Kandula, S., Zhang, M.: CloudCmp: comparing public cloud providers. In: Proceedings of the 10th Annual Conference on Internet Measurement, November 2010

    Google Scholar 

  9. Li, A., Yang, X., Kandula, S., Yang, X., Zhang, M.: CloudProphet: towards application performance prediction in cloud. In: Proceedings of ACM SIGCOMM 2011, Toronto, pp 426–427 (2011)

    Google Scholar 

  10. Zhao, L., Liu, A., Keung, J.: Evaluating cloud platform architecture with the care framework. In: Proceedings of 17th APSEC, pp. 60–69 (2010)

    Google Scholar 

  11. Luo, C., et al.: CloudRank-D: benchmarking and ranking cloud computing systems for data processing applications. Front. Comput. Sci. 6(4), 347–362 (2012)

    Google Scholar 

Download references

Acknowledgment

This work was partially funded by the Service Delivery and Aggregation Project within the Smart Services CRC.

Author information

Authors and Affiliations

  1. Faculty of Information and Communication Technologies, Swinburne University of Technology, Melbourne, VIC, 3122, Australia

    Mohan Baruwal Chhetri, Sergei Chichin, Quoc Bao Vo & Ryszard Kowalczyk

Authors
  1. Mohan Baruwal Chhetri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sergei Chichin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Quoc Bao Vo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ryszard Kowalczyk
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohan Baruwal Chhetri .

Editor information

Editors and Affiliations

  1. University of Sydney, Sydney, New South Wales, Australia

    Joseph G. Davis

  2. University of Washington, Tacoma, Washington, USA

    Haluk Demirkan

  3. IBM Almaden Research Center, San Jose, California, USA

    Hamid R. Motahari-Nezhad

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Baruwal Chhetri, M., Chichin, S., Vo, Q.B., Kowalczyk, R. (2014). Smart CloudBench - Test Drive the Cloud Before You Buy. In: Davis, J., Demirkan, H., Motahari-Nezhad, H. (eds) Service Research and Innovation. ASSRI 2013. Lecture Notes in Business Information Processing, vol 177. Springer, Cham. https://doi.org/10.1007/978-3-319-07950-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-07950-9_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-07949-3

  • Online ISBN: 978-3-319-07950-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation