skip to main content
10.1145/2207676.2208415acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Easing the generation of predictive human performance models from legacy systems

Published: 05 May 2012 Publication History

Abstract

With the rise of tools for predictive human performance modeling in HCI comes a need to model legacy applications. Models of legacy systems are used to compare products to competitors, or new proposed design ideas to the existing version of an application. We present CogTool-Helper, an exemplar of a tool that results from joining this HCI need to research in automatic GUI testing from the Software Engineering testing community. CogTool-Helper uses automatic UI-model extraction and test case generation to automatically create CogTool storyboards and models and infer methods to accomplish tasks beyond what the UI designer has specified. A design walkthrough with experienced CogTool users reveal that CogTool-Helper resonates with a "pain point" of real-world modeling and provide suggestions for future work.

References

[1]
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. (2004) An integrated theory of the mind. Psychological Review 111, 4, 1036--1060.
[2]
Bellamy, R., John, B. E., Kogan, S. (2011) Deploying CogTool: Integrating quantitative usability assessment into real-world software development. Proceeding of the 33rd International Conference on Software Engineering (ICSE '11). ACM, New York, NY, USA, 691--700.
[3]
Card, S. K., Moran, T. P., and Newell, A. 1983. The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.
[4]
Chang, T., Yeh, T., and Miller, R. C. (2010) GUI testing using computer vision, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 1535--1544.
[5]
Gray, W. D., John, B. E., & Atwood, M. E. (1993) Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-Computer Interaction, 8, 237--309.
[6]
Grechanik, M. Xie, Q. and Fu C. (2009) Creating GUI testing tools using accessibility technologies, Software Testing Verification and Validation Workshop, 243--250.
[7]
John, B. E., Prevas, K., Salvucci, D. D., and Koedinger, K. 2004. Predictive human performance modeling made easy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 455--462.
[8]
Kieras, D. E. (1999). A Guide to GOMS Model Usability Evaluation using GOMSL and GLEAN3. University of Michigan. Available at: ftp://www.eecs.umich.edu/people/kieras/GOMS/GOMSL_Guide.pdf
[9]
Knight, A., Pyrzak, G., and Green, C. 2007. When two methods are better than one: combining user study with cognitive modeling. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1783--1788.
[10]
Memon, A. M. (2002), GUI testing: pitfalls and process, IEEE Computer, 35(8), 87--88.
[11]
Memon, A. M. (2011) GUITAR- A GUI testing framework, available at: http://guitar.sourceforge.net.
[12]
Memon, A. M. (2011) TerpOffice, available at: http://www.cs.umd.edu/~atif/TerpOffice/
[13]
Memon, A. M., Banerjee, I and Nagarajan, A. (2003) GUI Ripping: Reverse engineering of graphical user interfaces for testing, In Proceedings of The 10th Working Conference on Reverse Engineering, 260--269.
[14]
Memon, A. M., Pollack, M. E. and Soffa, M. L. (2001) Hierarchical GUI test case generation using automated planning, IEEE Transactions on Software Engineering, 27(2), 144--155.
[15]
Monkiewicz, J. (1992). CAD's next-generation user interface. Computer-Aided Engineering, November, 1992, 55--56.
[16]
Pirolli, P. and Card, S. K. (1999). Information foraging. Psychological Review, 106, 643--675.
[17]
St. Amant, R., and Riedl, M. O. (2001). A perception/action substrate for cognitive modeling in HCI. International Journal of Human-Computer Studies 55(1), 15--39.
[18]
Teo, L., John, B. E., and Blackmon, M. H. (2012) CogTool-Explorer: A Model of Goal-Directed User Exploration that Considers Information Layout. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA.
[19]
White L. and Almezen, H. (2000). Generating test cases for GUI responsibilities using complete interaction sequences, in International Symposium on Software Reliability Engineering (ISSRE), 110--121.
[20]
Yuan, X. and Memon. A. M. (2010). Generating event sequence-based test cases using GUI runtime state feedback. IEEE Transactions on Software Engineering, 36(1), 81--95.

Cited By

View all
  • (2021)CogTool+ACM Transactions on Computer-Human Interaction10.1145/344753428:2(1-38)Online publication date: 17-Apr-2021
  • (2020)Review of Cognitive Modeling Software ToolsCognitive Modeling for Automated Human Performance Evaluation at Scale10.1007/978-3-030-45704-4_3(17-26)Online publication date: 17-Sep-2020
  • (2016)EventFlowSlicer: goal based test generation for graphical user interfacesProceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation10.1145/2994291.2994293(8-15)Online publication date: 18-Nov-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
May 2012
3276 pages
ISBN:9781450310154
DOI:10.1145/2207676
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. automatic gui testing
  2. predictive human performance modeling

Qualifiers

  • Research-article

Conference

CHI '12
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)CogTool+ACM Transactions on Computer-Human Interaction10.1145/344753428:2(1-38)Online publication date: 17-Apr-2021
  • (2020)Review of Cognitive Modeling Software ToolsCognitive Modeling for Automated Human Performance Evaluation at Scale10.1007/978-3-030-45704-4_3(17-26)Online publication date: 17-Sep-2020
  • (2016)EventFlowSlicer: goal based test generation for graphical user interfacesProceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation10.1145/2994291.2994293(8-15)Online publication date: 18-Nov-2016
  • (2013)Automated testing of GUI applications: models, tools, and controlling flakinessProceedings of the 2013 International Conference on Software Engineering10.5555/2486788.2487046(1479-1480)Online publication date: 18-May-2013
  • (2013)Human performance regression testingProceedings of the 2013 International Conference on Software Engineering10.5555/2486788.2486809(152-161)Online publication date: 18-May-2013
  • (2013)The first decade of GUI ripping: Extensions, applications, and broader impacts2013 20th Working Conference on Reverse Engineering (WCRE)10.1109/WCRE.2013.6671275(11-20)Online publication date: Oct-2013
  • (2013)Automated testing of GUI applications: Models, tools, and controlling flakiness2013 35th International Conference on Software Engineering (ICSE)10.1109/ICSE.2013.6606750(1479-1480)Online publication date: May-2013
  • (2013)Human performance regression testing2013 35th International Conference on Software Engineering (ICSE)10.1109/ICSE.2013.6606561(152-161)Online publication date: May-2013
  • (2012)Automated CPM-GOMS Modeling from Human DataProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131256121056:1(1005-1009)Online publication date: 1-Sep-2012
  • (2012)Tools for Predicting the Duration and Variability of SkilledProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131256120656:1(985-989)Online publication date: 1-Sep-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media