skip to main content
10.1145/3143434.3143455acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesiwsm-mensuraConference Proceedingsconference-collections
short-paper

Improving the real-time experience for software-measurement system end-users

Published:25 October 2017Publication History

ABSTRACT

Background: Software measurement systems are used in large companies to provide developers with up-to-date feedback and metrics. Aim /Problem: However, the front-ends of these systems are often not ready to provide a real-time experience for the end-users, who sometimes have to wait minutes before visualizations are provided. Method: In this paper we compare four alternative technological setups for these front-ends that were created within a large international telecommunication provider. We use a publicly available dataset for a performance evaluation and to analyze the results. Results: Our results indicate that the choice of the visualization component has a larger impact on the performance than the choice of the data storage. However, performance is also impacted by the combination of storage and visualization tools used.

References

  1. Ben Azvine, Zhan Cui, Detlef D Nauck, and B Majeed. 2006. Real time business intelligence for the adaptive enterprise. In E-Commerce Technology, 2006. The 8th IEEE International Conference on and Enterprise Computing, E-Commerce, and E-Services, The 3rd IEEE International Conference on. IEEE, 29--29.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Victor R Basili. 1992. Software modeling and measurement: the Goal/Question/Metric paradigm. Technical Report.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jacob T Biehl, Mary Czerwinski, Greg Smith, and George G Robertson. 2007. FASTDash: a visual dashboard for fostering awareness in software teams. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1313--1322.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Francesco Faita, Vincenzo Gemignani, Elisabetta Bianchini, Chiara Giannarelli, Lorenzo Ghiadoni, and Marcello Demi. 2008. Real-time Measurement System for Evaluation of the Carotid Intima-Media Thickness With a Robust Edge Operator. Journal of ultrasound in medicine 27, 9 (2008), 1353--1361. Google ScholarGoogle ScholarCross RefCross Ref
  5. Robert Houghton, Omar A El Sawy, Paul Gray, Craig Donegan, and Ashish Joshi. 2004. Vigilant information systems for managing enterprises in dynamic supply chains: Real-time dashboards at Western Digital. MIS Quarterly Executive 3, 1 (2004), 19--35.Google ScholarGoogle Scholar
  6. Jan Schwarzer, Susanne Draheim, Kai von Luck, Qi Wang, Pablo Casaseca, and Christos Grecos. 2016. Ambient Surfaces: Interactive Displays in the Informative Workspace of Co-located Scrum Teams. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, NY, USA, Article 69. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Miroslaw Staron and Wilhelm Meding. 2009. Ensuring Reliability of Information Provided by Measurement Systems. Springer Berlin Heidelberg, Berlin, Heidelberg, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Miroslaw Staron and Wilhelm Meding. 2015. Measurement-as-a-Service - A New Way of Organizing Measurement Programs in Large Software Development Companies. Springer International Publishing, Cham, 144--159. Google ScholarGoogle ScholarCross RefCross Ref
  9. Miroslaw Staron, Wilhelm Meding, Göran Karlsson, and Christer Nilsson. 2011. Developing measurement systems: an industrial case study. Journal of Software Maintenance and Evolution: Research and Practice 23, 2 (2011), 89--107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Pawel Terlecki, Fei Xu, Marianne Shaw, Valeri Kim, and Richard Wesley. 2015. On Improving User Response Times in Tableau. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD '15). ACM, New York, NY, USA, 1695--1706. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. András Vargha and Harold D Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 25, 2 (2000), 101--132.Google ScholarGoogle Scholar
  12. Richard Wesley, Matthew Eldridge, and Pawel T Terlecki. 2011. An analytic data engine for visualization in tableau. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of data. ACM, 1185--1194. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Improving the real-time experience for software-measurement system end-users

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      IWSM Mensura '17: Proceedings of the 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement
      October 2017
      273 pages
      ISBN:9781450348539
      DOI:10.1145/3143434

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 25 October 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • short-paper
    • Article Metrics

      • Downloads (Last 12 months)5
      • Downloads (Last 6 weeks)1

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader