skip to main content
10.1145/1937117.1937118acmconferencesArticle/Chapter ViewAbstractPublication PagessplashConference Proceedingsconference-collections
research-article

Using CogTool to model programming tasks

Published: 17 October 2010 Publication History

Abstract

In this paper, we describe the use of CogTool, a tool that enables non-psychologists to create cognitive models of user tasks from which reliable estimates of skilled user task times can be derived. We show how CogTool was used to compare a new parallel programming toolkit built on Eclipse, with Vim, a programming editor typically used in command line environments. This comparison was conducted to evaluate new parallel/scientific systems as part of the US Defense Advanced Research Projects Agency's High Productivity Computing Systems initiative. Our models indicate that for the four tasks analyzed, the new Eclipse tools are faster than the command line environments. Surprisingly, our models also reveal that despite programmers' preference for keyboard interaction in command line environments, mouse-based interaction is sometimes faster.

References

[1]
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., & Qin, Y. (2004) An integrated theory of the mind. Psychological Review 111, (4). 1036--1060.
[2]
Brown, A. B. and Hellerstein, J. L. (2004) An Approach to Benchmarking Configuration Complexity Proceedings of the 11th workshop on ACM SIGOPS European workshop.
[3]
Card, S. K., Moran, T. P., & Newell, A. (1983) The Psychology of Human-Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.
[4]
Furnas, G. W. (1986) Generalized fisheye views. SIGCHI Bulletin. 17, 4, 16--23.
[5]
John, B. E., (2010) Reducing the Variability between Novice Modelers: Results of a Tool for Human Performance Modeling Produced through Human-Centered Design. Proceedings of the 19th Annual Conference on Behavior Representation in Modeling and Simulation (BRIMS) (Charleston, SC, March 22--25, 2010).
[6]
John, B. E., (submitted) Using Predictive Human Performance Models to Inspire and Support UI Design Recommendations. Manuscript submitted for publication.
[7]
John, B., Prevas, K., Salvucci, D., & Koedinger, K. (2004) Predictive Human Performance Modeling Made Easy. Proceedings of CHI, 2004 (Vienna, Austria, April 24--29, 2004) ACM, New York.
[8]
Kirschenbaum, S. S., Gray, W. D., Ehret, B. D., & Miller, S. L. (1996) When using the tool interferes with doing the task. In M. J. Tauber (Ed.), Conference companion of the ACM CHI'96 Conference Human Factors in Computing Systems (pp. 203--204). New York: ACM Press.
[9]
Lawrance, J., Bellamy, R., Burnett, M. (2007) Scents in programs: Does information foraging theory apply to program maintenance? In Proceedings of Visual Languages and Human-Centric Computing, IEEE.
[10]
Pirolli, P. & Card, S. (1999) "Information foraging," Psychology Review, vol. 106, no. 4, pp. 643--675.
[11]
Teo, L. & John, B. E. (2008) Towards predicting user interaction with CogTool-Explorer. Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting (New York, NY, Sept 22--26, 2008).

Cited By

View all
  • (2021)Application of Cognitive Performance Modeling for Usability Evaluation of Emergency Medical Services In-Vehicle TechnologyProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132064102164:1(72-76)Online publication date: 9-Feb-2021
  • (2021)CogTool+ACM Transactions on Computer-Human Interaction10.1145/344753428:2(1-38)Online publication date: 17-Apr-2021
  • (2021)FLM-2A: Towards Automated HCI Modeling of Android Applications Based on a Modified Version of the Keystroke Level ModelHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_25(329-342)Online publication date: 3-Jul-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
PLATEAU '10: Evaluation and Usability of Programming Languages and Tools
October 2010
51 pages
ISBN:9781450305471
DOI:10.1145/1937117
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CogTool
  2. cognitive modeling
  3. information foraging theory
  4. programmer productivity

Qualifiers

  • Research-article

Funding Sources

Conference

SPLASH '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 5 of 8 submissions, 63%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Application of Cognitive Performance Modeling for Usability Evaluation of Emergency Medical Services In-Vehicle TechnologyProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132064102164:1(72-76)Online publication date: 9-Feb-2021
  • (2021)CogTool+ACM Transactions on Computer-Human Interaction10.1145/344753428:2(1-38)Online publication date: 17-Apr-2021
  • (2021)FLM-2A: Towards Automated HCI Modeling of Android Applications Based on a Modified Version of the Keystroke Level ModelHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_25(329-342)Online publication date: 3-Jul-2021
  • (2020)Review of Cognitive Modeling Software ToolsCognitive Modeling for Automated Human Performance Evaluation at Scale10.1007/978-3-030-45704-4_3(17-26)Online publication date: 17-Sep-2020
  • (2019)Research of Human-Machine Interface Evaluation Based on CogtoolHuman Interface and the Management of Information. Visual Information and Knowledge Management10.1007/978-3-030-22660-2_27(371-391)Online publication date: 28-Jun-2019
  • (2018)Can a metric judge usability of software? A psychometric walkthroughInternational Journal of Computer Applications in Technology10.1504/IJCAT.2018.09407358:1(80-88)Online publication date: 1-Jan-2018
  • (2014)Evaluating the Usability of Domain-Specific LanguagesSoftware Design and Development10.4018/978-1-4666-4301-7.ch098(2120-2141)Online publication date: 2014
  • (2013)Evaluating the Usability of Domain-Specific LanguagesFormal and Practical Aspects of Domain-Specific Languages10.4018/978-1-4666-2092-6.ch014(386-407)Online publication date: 2013
  • (2013)Design of Electronic Medical Record User Interfaces: A Matrix-Based Method for Improving UsabilityJournal of Healthcare Engineering10.1260/2040-2295.4.3.4274:3(427-452)Online publication date: Sep-2013
  • (2012)Usability Evaluation of Domain-Specific LanguagesProceedings of the 2012 Eighth International Conference on the Quality of Information and Communications Technology10.1109/QUATIC.2012.63(342-347)Online publication date: 2-Sep-2012

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media