Skip to main content
SpringerLink
Log in

Comparing TPC-W and RUBiS via PCA

  • Conference paper
  • First Online:
Intelligent Information and Database Systems (ACIIDS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10191))

Included in the following conference series:

  • 1822 Accesses

Abstract

We aim to understand the fundamental design correspondences between TPC-W and RUBiS, two benchmark applications modeled after the well-known E-commerce solutions Amazon and eBay, respectively. Furthermore, we investigate how these benchmarks reflect the design principles of real-world applications by comparing them against Qualitas Corpus, offering an effective domain context of curated Java software systems. To perform this study, we employ Principal Component Analysis (PCA) to distill the important information (i.e., the principal components) from a set of observations of possibly correlated variables (i.e., software metrics). The results of our analysis reveal that TPC-W and RUBiS are comprised of surprisingly dissimilar features that clearly show that TPC-W and RUBiS do not share too many design commonalities. Moreover, we demonstrate that PCA is a powerful tool to uncover key software quality attributes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://rubis.ow2.org.

  2. 2.

    http://www.tpc.org/tpcw/.

References

  1. Basili, V.R.: The role of experimentation in software engineering: past, current, and future. In: Boehm, B., Rombach, D.H., Zelkowitz, M.V. (eds.) Foundations of Empirical Software Engineering, pp. 1–13. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  2. Chhetri, M.B., Chichin, S., Vo, Q.B., Kowalczyk, R.: Smart CloudMonitor-providing visibility into performance of black-box clouds. In: Proceedings of 2014 IEEE 7th International Conference on Cloud Computing (CLOUD 2014), pp. 777–784. IEEE, July 2014

    Google Scholar 

  3. Chidamber, S.R., Kemerer, C.F.: A metrics suite for object oriented design. IEEE Trans. Softw. Eng. 20(6), 476–493 (1994)

    Article  Google Scholar 

  4. El Emam, K., Benlarbi, S., Goel, N., Rai, S.N.: The confounding effect of class size on the validity of object-oriented metrics. IEEE Trans. Softw. Eng. 27(7), 630–650 (2001)

    Article  Google Scholar 

  5. Fenton, N.E., Bieman, J.: Software Metrics: A Rigorous and Practical Approach, 3rd edn. CRC Press, Boca Raton (2015)

    MATH  Google Scholar 

  6. Husson, F., Lê, S., Pagès, J.: Exploratory Multivariate Analysis by Example Using R. CRC Press, Boca Raton (2011)

    MATH  Google Scholar 

  7. Kitchenham, B., Pfleeger, S.L., Fenton, N.E.: Towards a framework for software measurement validation. IEEE Trans. Softw. Eng. 21(12), 929–944 (1995)

    Article  Google Scholar 

  8. Lumpe, M., Mahmud, S., Goloshchapova, O.: jCT: java code tomograph. In: Proceedings of 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), Lawrence, Kansas, USA, pp. 616–619, November 2011

    Google Scholar 

  9. McCabe, T.J.: A complexity measure. In: ICSE Proceedings of 2nd International Conference on Software Engineering, USA, pp. 407–419 (1976)

    Google Scholar 

  10. Messerschmitt, D.G., Szyperski, C.: Software Ecosystem: Understanding an Indispensable Technology and Industry. The MIT Press, Cambridge (2003)

    Google Scholar 

  11. Mordal, K., Anquetil, N., Laval, J., Serebrenik, A., Vasilescu, B., Ducasse, S.: Software quality metrics aggregation in industry. Softw. Evol. Proc. 25, 1117–1135 (2012)

    Article  Google Scholar 

  12. Sen, A.K.: On Economic Inequality. Oxford University Press, Oxford (1973)

    Book  Google Scholar 

  13. Stevens, S.: On the theory of scales of measurement. Sci. New Ser. 103(2684), 677–680 (1946)

    MATH  Google Scholar 

  14. Succi, G., Pedrycz, W., Djokic, S., Zuliani, P., Russo, B.: An empirical exploration of the distributions of the chidamber and kemerer object-oriented metrics suite. Empirical Softw. Eng. 10(1), 81–103 (2005)

    Article  Google Scholar 

  15. Tempero, E.: How fields are used in java: an empirical study. In: Proceedings of 20th Australian Software Engineering Conference (ASWEC 2009), Gold Coast, Queensland, IEEE Computer Society, pp. 91–100 (2009)

    Google Scholar 

  16. Tempero, E., Anslow, C., Dietrich, J., Han, T., Li, J., Lumpe, M., Melton, H., Noble, J.: The qualitas corpus: a curated collection of java code for empirical studies. In: Proceedings of 17th Asia Pacific Software Engineering Conference (APSEC 2010), Sydney, Australia, pp. 336–345, December 2010

    Google Scholar 

  17. Vasa, R., Lumpe, M., Branch, P., Nierstrasz, O.: Comparative analysis of evolving software systems using the Gini coefficient. In: Proceedings of 25th IEEE International Conference on Software Maintenance (ICSM 2009), Edmonton, Alberta, pp. 179–188. IEEE Computer Society, September 2009

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Science, Engineering and Technology, Swinburne University of Technology, Hawthorn, Victoria, Australia

    Markus Lumpe & Quoc Bao Vo

Authors
  1. Markus Lumpe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Quoc Bao Vo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Markus Lumpe .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology , Wroclaw, Poland

    Ngoc Thanh Nguyen

  2. Japan Advanced Institute of Science and Technology , Nomi, Japan

    Satoshi Tojo

  3. Japan Advanced Institute of Science and Technology , Nomi, Japan

    Le Minh Nguyen

  4. Wrocław University of Science and Technology , Wrocław, Poland

    Bogdan Trawiński

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Lumpe, M., Vo, Q.B. (2017). Comparing TPC-W and RUBiS via PCA. In: Nguyen, N., Tojo, S., Nguyen, L., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2017. Lecture Notes in Computer Science(), vol 10191. Springer, Cham. https://doi.org/10.1007/978-3-319-54472-4_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-54472-4_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-54471-7

  • Online ISBN: 978-3-319-54472-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation