ABSTRACT
Background: Software measurement systems are used in large companies to provide developers with up-to-date feedback and metrics. Aim /Problem: However, the front-ends of these systems are often not ready to provide a real-time experience for the end-users, who sometimes have to wait minutes before visualizations are provided. Method: In this paper we compare four alternative technological setups for these front-ends that were created within a large international telecommunication provider. We use a publicly available dataset for a performance evaluation and to analyze the results. Results: Our results indicate that the choice of the visualization component has a larger impact on the performance than the choice of the data storage. However, performance is also impacted by the combination of storage and visualization tools used.
- Ben Azvine, Zhan Cui, Detlef D Nauck, and B Majeed. 2006. Real time business intelligence for the adaptive enterprise. In E-Commerce Technology, 2006. The 8th IEEE International Conference on and Enterprise Computing, E-Commerce, and E-Services, The 3rd IEEE International Conference on. IEEE, 29--29.Google ScholarDigital Library
- Victor R Basili. 1992. Software modeling and measurement: the Goal/Question/Metric paradigm. Technical Report.Google ScholarDigital Library
- Jacob T Biehl, Mary Czerwinski, Greg Smith, and George G Robertson. 2007. FASTDash: a visual dashboard for fostering awareness in software teams. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1313--1322.Google ScholarDigital Library
- Francesco Faita, Vincenzo Gemignani, Elisabetta Bianchini, Chiara Giannarelli, Lorenzo Ghiadoni, and Marcello Demi. 2008. Real-time Measurement System for Evaluation of the Carotid Intima-Media Thickness With a Robust Edge Operator. Journal of ultrasound in medicine 27, 9 (2008), 1353--1361. Google ScholarCross Ref
- Robert Houghton, Omar A El Sawy, Paul Gray, Craig Donegan, and Ashish Joshi. 2004. Vigilant information systems for managing enterprises in dynamic supply chains: Real-time dashboards at Western Digital. MIS Quarterly Executive 3, 1 (2004), 19--35.Google Scholar
- Jan Schwarzer, Susanne Draheim, Kai von Luck, Qi Wang, Pablo Casaseca, and Christos Grecos. 2016. Ambient Surfaces: Interactive Displays in the Informative Workspace of Co-located Scrum Teams. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, NY, USA, Article 69. Google ScholarDigital Library
- Miroslaw Staron and Wilhelm Meding. 2009. Ensuring Reliability of Information Provided by Measurement Systems. Springer Berlin Heidelberg, Berlin, Heidelberg, 1--16. Google ScholarDigital Library
- Miroslaw Staron and Wilhelm Meding. 2015. Measurement-as-a-Service - A New Way of Organizing Measurement Programs in Large Software Development Companies. Springer International Publishing, Cham, 144--159. Google ScholarCross Ref
- Miroslaw Staron, Wilhelm Meding, Göran Karlsson, and Christer Nilsson. 2011. Developing measurement systems: an industrial case study. Journal of Software Maintenance and Evolution: Research and Practice 23, 2 (2011), 89--107. Google ScholarDigital Library
- Pawel Terlecki, Fei Xu, Marianne Shaw, Valeri Kim, and Richard Wesley. 2015. On Improving User Response Times in Tableau. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD '15). ACM, New York, NY, USA, 1695--1706. Google ScholarDigital Library
- András Vargha and Harold D Delaney. 2000. A critique and improvement of the CL common language effect size statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 25, 2 (2000), 101--132.Google Scholar
- Richard Wesley, Matthew Eldridge, and Pawel T Terlecki. 2011. An analytic data engine for visualization in tableau. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of data. ACM, 1185--1194. Google ScholarDigital Library
Index Terms
- Improving the real-time experience for software-measurement system end-users
Recommendations
How do software developers experience team performance in lean and agile environments?
EASE '14: Proceedings of the 18th International Conference on Evaluation and Assessment in Software EngineeringContext: Companies increasingly strive to adapt to market and ecosystem changes in real time. Evaluating team performance in such changing environments presents a major challenge. Objective: This paper aims to understand how software developers ...
How business process reengineering affects information technology investment and employee performance under different performance measurement
Business Process Reengineering (BPR) is an approach for business process transformation and unconstrained reshaping of all business processes. This study examines the impact of BPR on information technology (IT) investment and employee performance. In ...
End users as unwitting software developers
WEUSE '08: Proceedings of the 4th international workshop on End-user software engineeringThe widespread use of personal software systems and the boom of the so-called Web 2.0 is erasing the distinctions between those who create software products and those who use or consume them. End users are increasingly involved in the design and ...
Comments