research-article

Measuring the performance of interactive applications with listener latency profiling

Authors:

Matthias HauswirthAuthors Info & Claims

PPPJ '08: Proceedings of the 6th international symposium on Principles and practice of programming in Java

Pages 137 - 146

https://doi.org/10.1145/1411732.1411751

Published: 09 September 2008 Publication History

Abstract

When Java developers need to improve the performance of their applications, they usually use one of the many existing profilers for Java. These profilers generally capture a profile that represents the execution time spent in each method. The developer can thus focus her optimization efforts on the methods that consume the most time. In this paper we argue that this type of profile is insufficient for tuning interactive applications. Interactive applications respond to user events, such as mouse clicks and key presses. The perceived performance of interactive applications is directly related to the response time of the program.

In this paper we present listener latency profiling, a profiling approach with two distinctive characteristics. First, we call it latency profiling because it helps developers to find long latency operations. Second, we call it listener profiling because it abstracts away from method-level profiles to compute the latency of the various listeners. This allows a developer to reason about performance with respect to listeners, also called observers, the high level abstraction at the core of any interactive Java application.

We present our listener latency profiling approach, describe LiLa, our implementation, validate it on a set of micro-benchmarks, and evaluate it on a complex real-world interactive application.

References

[1]

I. Ceaparu, J. Lazar, K. Bessiere, J. Robinson, and B. Shneiderman. Determining causes and severity of end-user frustration. International Journal of Human-Computer Interaction, 17(3), 2004.

[2]

J. R. Dabrowski and E. V. Munson. Is 100 milliseconds too fast? In CHI '01: CHI '01 extended abstracts on Human factors in computing systems, 2001.

Digital Library

[3]

Y. Endo and M. Seltzer. Improving interactive performance using TIPME. In Proceedings of the SIGMETRICS international conference on Measurement and modeling of computer systems, 2000.

Digital Library

[4]

Y. Endo, Z. Wang, J. B. Chen, and M. Seltzer. Using latency to evaluate interactive system performance. In OSDI '96: Proceedings of the second USENIX symposium on Operating systems design and implementation, 1996.

Digital Library

[5]

K. Flautner, R. Uhlig, S. Reinhardt, and T. Mudge. Thread-level parallelism and interactive performance of desktop applications. In ASPLOS-IX: Proceedings of the ninth international conference on Architectural support for programming languages and operating systems, 2000.

Digital Library

[6]

Eclipse Foundation. The PerformanceStats API: Gathering performance statistics in Eclipse. http://www.eclipse.org/eclipse/platform-core/documents/3.1/perf_stats.html, 2005.

[7]

Eclipse Foundation. Eclipse Project. http://www.eclipse.org/eclipse/, 2006.

[8]

I. S. MacKenzie and C. Ware. Lag as a determinant of human performance in interactive systems. In CHI '93: Proceedings of the SIGCHI conference on Human factors in computing systems, 1993.

Digital Library

[9]

J. McAffer and J.-M. Lemieux. Eclipse Rich Client Platform: Designing, Coding, and Packaging Java Applications. Addison-Wesley, 2005.

Digital Library

[10]

S. Northover and M. Wilson. SWT: The Standard Widget Toolkit, Volume 1. Addison-Wesley, 2004.

Digital Library

[11]

ObjectWeb. ASM. Web pages at http://asm.objectweb.org/.

[12]

T. Richardson, Q. Stafford-Fraser, K. R. Wood, and A. Hopper. Virtual network computing. IEEE Internet Computing, 02(1), 1998.

Digital Library

[13]

B. Shneiderman. Response time and display rate in human performance with computers. ACM Comput. Surv., 16(3), 1984.

Digital Library

[14]

B. Shneiderman. Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley, 1986.

Digital Library

[15]

K. Walrath, M. Campione, A. Huml, and S. Zakhour. The JFC Swing Tutorial: A Guide to Constructing GUIs, 2nd Edition. Addison-Wesley, 2004.

Digital Library

[16]

N. Zeldovich and R. Chandra. Interactive performance measurement with VNCplay. In FREENIX Track: USENIX Annual Technical Conference, April 2005.

Digital Library

Cited By

McCarthy HKoay ADawson MKent KPatros P(2021)Benchmarking and learning garbage collection delays for resource‐restricted graphical user interfacesSoftware: Practice and Experience10.1002/spe.300552:1(172-193)Online publication date: 21-Jun-2021
https://doi.org/10.1002/spe.3005
Hassan HSarhan Q(2020)Performance Evaluation of Graphical User Interfaces in Java and C#2020 International Conference on Computer Science and Software Engineering (CSASE)10.1109/CSASE48920.2020.9142075(290-295)Online publication date: Apr-2020
https://doi.org/10.1109/CSASE48920.2020.9142075
Patros PDawson MKent K(2018)Garbage Collections Delays on Java GUIs2018 Eleventh International Conference on Mobile Computing and Ubiquitous Network (ICMU)10.23919/ICMU.2018.8653592(1-6)Online publication date: Oct-2018
https://doi.org/10.23919/ICMU.2018.8653592
Show More Cited By

Recommendations

Listener latency profiling: Measuring the perceptible performance of interactive Java applications

When developers need to improve the performance of their applications, they usually use one of the many existing profilers. These profilers generally capture a profile that represents the execution time spent in each method. The developer can thus focus ...
Platform-independent profiling in a virtual execution environment

Virtual execution environments, such as the Java virtual machine, promote platform-independent software development. However, when it comes to analyzing algorithm complexity and performance bottlenecks, available tools focus on platform-specific metrics,...
A portable and customizable profiling framework for java based on bytecode instruction counting
APLAS'05: Proceedings of the Third Asian conference on Programming Languages and Systems

Prevailing profilers for Java, which rely on standard, native-code profiling interfaces, are not portable, give imprecise results due to serious measurement perturbation, and cause excessive overheads. In contrast, program transformations allow to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PPPJ '08: Proceedings of the 6th international symposium on Principles and practice of programming in Java

September 2008

198 pages

ISBN:9781605582238

DOI:10.1145/1411732

Conference Chairs:
Luis Veiga
Universidade Técnica de Lisboa, Portugal
,
Vasco Amaral
Universidade Nova de Lisboa, Portugal

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Swiss National Science Foundation

Conference

PPPJ08

Sponsor:

ACM

PPPJ08: Principles and Practice of Prgramming in Java 2008

September 9 - 11, 2008

Modena, Italy

Acceptance Rates

Overall Acceptance Rate 29 of 58 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
285
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

McCarthy HKoay ADawson MKent KPatros P(2021)Benchmarking and learning garbage collection delays for resource‐restricted graphical user interfacesSoftware: Practice and Experience10.1002/spe.300552:1(172-193)Online publication date: 21-Jun-2021
https://doi.org/10.1002/spe.3005
Hassan HSarhan Q(2020)Performance Evaluation of Graphical User Interfaces in Java and C#2020 International Conference on Computer Science and Software Engineering (CSASE)10.1109/CSASE48920.2020.9142075(290-295)Online publication date: Apr-2020
https://doi.org/10.1109/CSASE48920.2020.9142075
Patros PDawson MKent K(2018)Garbage Collections Delays on Java GUIs2018 Eleventh International Conference on Mobile Computing and Ubiquitous Network (ICMU)10.23919/ICMU.2018.8653592(1-6)Online publication date: Oct-2018
https://doi.org/10.23919/ICMU.2018.8653592
Fan XSinnen OGiacaman N(2018)Balancing parallelization and asynchronization in event‐driven programs with OpenMPConcurrency and Computation: Practice and Experience10.1002/cpe.495931:4Online publication date: 21-Sep-2018
https://doi.org/10.1002/cpe.4959
Rosà ARosales EBinder W(2017)Accurate reification of complete supertype information for dynamic analysis on the JVMACM SIGPLAN Notices10.1145/3170492.313606152:12(104-116)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3170492.3136061
Rosà ARosales EBinder WFlatt MErdweg S(2017)Accurate reification of complete supertype information for dynamic analysis on the JVMProceedings of the 16th ACM SIGPLAN International Conference on Generative Programming: Concepts and Experiences10.1145/3136040.3136061(104-116)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3136040.3136061
Vankeirsbilck BSimoens PDe Turck FDemeester PDhoedt B(2014)Network latency hiding in thin client systems through server-centric speculative display updatingJournal of Network and Computer Applications10.1016/j.jnca.2013.12.00341(228-239)Online publication date: May-2014
https://doi.org/10.1016/j.jnca.2013.12.003
Vankeirsbilck BVerslype DStaelens NSimoens PDevelder CDemeester PTurck FDhoedt B(2014)Platform for real-time subjective assessment of interactive multimedia applicationsMultimedia Tools and Applications10.1007/s11042-013-1395-y72:1(749-775)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1007/s11042-013-1395-y
Salli ONevalainen OLeppänen V(2013)Event-driven asynchronous method calls with the D-Bus message systemSoftware: Practice and Experience10.1002/spe.221645:1(53-74)Online publication date: 26-Jul-2013
https://doi.org/10.1002/spe.2216
Jovic MAdamoli AHauswirth M(2011)Catch me if you canACM SIGPLAN Notices10.1145/2076021.204808146:10(155-170)Online publication date: 22-Oct-2011
https://dl.acm.org/doi/10.1145/2076021.2048081
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten