skip to main content
research-article

Investigating the Post-Training Persistence of Expert Interaction Techniques

Published: 23 August 2017 Publication History

Abstract

Expert interaction techniques enable users to greatly improve their performance; however, to realize these advantages, the user must first acquire the skill necessary to use a technique, then choose to use it over competing novice techniques. This article investigates several factors that may influence whether use of an expert technique persists when the context of use changes. Two studies examine the effect of changing performance requirements, and find that a high performance requirement imposed in a training context can effectively push users to adopt an expert technique, and that use of the technique is maintained when the requirement is subsequently reduced or removed. In a final study, performance requirement, high-level task, and environment of use are changed—participants played a training game to learn the menu for a drawing application, which they then used to complete a series of drawings over the following week. Participants exhibited a somewhat surprising “all-or-nothing” effect, using the expert technique nearly exclusively or not at all, and maintaining this behavior over a range of qualitatively different tasks. This suggests that switching to an expert technique involves a global change by the user, rather than an incremental change as suggested by previous work.

References

[1]
Jack A. Adams. 1987. Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. Psychol. Bull. 101, 1 (1987), 41–74.
[2]
Fraser Anderson and Walter F. Bischof. 2013. Learning and performance with gesture guides. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). New York, NY: ACM, 1109–1118.
[3]
John R. Anderson. 1983. The Architecture of Cognition. Cambridge, MA: Harvard University Press.
[4]
Michelle Annett and Walter F. Bischof. 2013. Your left hand can do it too! Investigating intermanual, symmetric gesture transfer on touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). New York, NY: ACM, 1119–1128.
[5]
Caroline Appert and Shumin Zhai. 2009. Using strokes as command shortcuts: Cognitive benefits and toolkit support. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). New York, NY: ACM, 2289–2298.
[6]
Winfred Arthur, Winston Bennett, Pamela L. Stanush, and Theresa L. McNelly. 1998. Factors that influence skill decay and retention: A quantitative review and analysis. Hum. Perform. 11, 1 (March 1998), 57–101.
[7]
Timothy T. Baldwin and J. Kevin Ford. 1988. Transfer of training: A review and directions for future research. Pers. Psychol. 41, 1 (March 1988), 63–105.
[8]
Scott Bateman, Jaime Teevan, and Ryen W. White. 2012. The search dashboard: How reflection and comparison impact search behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). New York, NY: ACM, 1785–1794.
[9]
Roy F. Baumeister, Ellen Bratslavsky, Catrin Finkenauer, and Kathleen D. Vohs. 2001. Bad is stronger than good. Rev. Gen. Psychol. 5, 4 (2001), 323–370.
[10]
Howard J. Baumgartel, Jill I. Reynolds, and Rukhsana Z. Pathan. 1984. How personality and organisational climate variables moderate the effectiveness of management development programmes: A review and some recent research findings. Manag. Labour Stud. 9, 1 (1984), 1--16.
[11]
Suresh K. Bhavnani and Bonnie E. John. 2000. The strategic use of complex computer systems. Hum.-Comput. Interact. 15, 2 (September 2000), 107–137.
[12]
Mary L. Broad and John W. Newstrom. 1992. Transfer of Training: Action-Packed Strategies to Ensure High Payoff from Training Investments. Addison-Wesley Publishing Company.
[13]
William A. S. Buxton. 1995. Chunking and phrasing and the design of human-computer dialogues. In. Human-Computer Interaction. Ronald M. Baecker, Jonathan Grudin, William A. S. Buxton, and Saul Greenberg (Eds.), San Francisco, CA: Morgan Kaufmann Publishers, Inc. 494–499.
[14]
Stuart K. Card, Allen Newell, and Thomas P. Moran. 1983. The Psychology of Human-Computer Interaction. Hillsdale, NJ: L. Erlbaum Associates Inc.
[15]
John M. Carroll and Mary Beth Rosson. 1987. Paradox of the active user. In Interfacing Thought: Cognitive Aspects of Human-Computer Interaction. MIT Press, 80–111.
[16]
Nicholas J. Cepeda, Harold Pashler, Edward Vul, John T. Wixted, and Doug Rohrer. 2006. Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychol. Bull. 132, 3 (2006), 354–380.
[17]
Andy Cockburn, Carl Gutwin, and Saul Greenberg. 2007a. A predictive model of menu performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). New York, NY: ACM, 627–636.
[18]
Andy Cockburn, Per Ola Kristensson, Jason Alexander, and Shumin Zhai. 2007b. Hard lessons: Effort-inducing interfaces benefit spatial learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). New York, NY: ACM, 1571–1580.
[19]
Andy Cockburn, Carl Gutwin, Joey Scarr, and Sylvain Malacria. 2014. Supporting novice to expert transitions in user interfaces. ACM Comput. Surv. 47, 2 (November 2014), 31:1–31:36.
[20]
Deborah Compeau, Lorne Olfman, Maung Sei, and Jane Webster. 1995. End-user training and learning. Commun. ACM 38, 7 (July 1995), 24–26.
[21]
Fergus I. M. Craik and Robert S. Lockhart. 1972. Levels of processing: A framework for memory research. J. Verbal Learn. Verbal Behav. 11, 6 (December 1972), 671–684.
[22]
E. R. F. W. Crossman. 1959. A theory of the acquisition of speed-skill. Ergonomics 2, 2 (February 1959), 153–166.
[23]
James E. Driskell, Ruth P. Willis, and Carolyn Copper. 1992. Effect of overlearning on retention. J. Appl. Psychol. 77, 5 (1992), 615–622.
[24]
Hermann Ebbinghaus. 1913. Memory: A Contribution to Experimental Psychology. University Microfilms.
[25]
K. Anders Ericsson, Ralf Th. Krampe, and Clemens Tesch-Romer. 1993. The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. (1993), 363–406.
[26]
Paul Morris Fitts and Michael I. Posner. 1967. Human Performance. Brooks/Cole Publishing Company.
[27]
J. Kevin Ford, Miguel A. Quiñones, Douglas J. Sego, and Joann Speer Sorra. 1992. Factors affecting the opportunity to perform trained tasks on the job. Pers. Psychol. 45, 3 (September 1992), 511–527.
[28]
J. Kevin Ford and Daniel A. Weissbein. 1997. Transfer of training: An updated review and analysis. Perform. Improv. Q. 10, 2 (June 1997), 22–41.
[29]
Marguerite Foxon. 1993. A process approach to the transfer of training. Australas. J. Educ. Technol. 9, 2 (December 1993).
[30]
Wai-Tat Fu and Wayne D. Gray. 2004. Resolving the paradox of the active user: Stable suboptimal performance in interactive tasks. Cogn. Sci. 28, 6 (November 2004), 901–935.
[31]
A. M. Gentile. 1972. A working model of skill acquisition with application to teaching. Quest 17, 1 (January 1972), 3–23.
[32]
Marilyn E. Gist, Anna G. Bavetta, and Cynthia Kay Stevens. 1990. Transfer training method: Its influence on skill generalization, skill repetition, and performance level. Pers. Psychol. 43, 3 (September 1990), 501–523.
[33]
Wayne D. Gray and Deborah A. Boehm-Davis. 2000. Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. J. Exp. Psychol. Appl. 6, 4 (2000), 322–335.
[34]
Wayne D. Gray and John K. Lindstedt. 2016. Plateaus, dips, and leaps: Where to look for inventions and discoveries during skilled performance. Cogn. Sci. (October 2016).
[35]
Wayne D. Gray, Chris R. Sims, Wai-Tat Fu, and Michael J. Schoelles. 2006. The soft constraints hypothesis: A rational analysis approach to resource allocation for interactive behavior. Psychol. Rev. 113, 3 (July 2006), 461–482.
[36]
Nathan Green, Jan Kruger, Chirag Faldu, and Robert St. Amant. 2004. A reduced QWERTY keyboard for mobile text entry. In Proceedings of the CHI’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA’04). New York, NY: ACM, 1429–1432.
[37]
Tovi Grossman, Pierre Dragicevic, and Ravin Balakrishnan. 2007. Strategies for accelerating on-line learning of hotkeys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). New York, NY: ACM, 1591–1600.
[38]
Carl Gutwin, Andy Cockburn, and Benjamin Lafreniere. 2015. Testing the rehearsal hypothesis with two FastTap interfaces. In Proceedings of Graphics Interface (GI’15). Canadian Information Processing Society.
[39]
Carl Gutwin, Andy Cockburn, Joey Scarr, Sylvain Malacria, and Scott C. Olson. 2014. Faster command selection on tablets with FastTap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’14). New York, NY: ACM, 2617–2626.
[40]
Jeff Hendy, Kellogg S. Booth, and Joanna McGrenere. 2010. Graphically enhanced keyboard accelerators for GUIs. In Proceedings of Graphics Interface (GI’10). Toronto, ON, Canada: Canadian Information Processing Society, 3–10.
[41]
R. J. Herrnstein, George F. Loewenstein, Drazen Prelec, and William Vaughan. 1993. Utility maximization and melioration: Internalities in individual choice. J. Behav. Decis. Mak. 6, 3 (September 1993), 149–185.
[42]
Poika Isokoski and Roope Raisamo. 2000. Device independent text input: A rationale and an example. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI’00). New York, NY: ACM, 76–83.
[43]
Daniel Kahneman. 2013. Thinking, Fast and Slow. Anchor Canada.
[44]
Brian Krisler and Richard Alterman. 2008. Training towards mastery: Overcoming the active user paradox. In Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges (NordiCHI’08). New York, NY: ACM, 239–248.
[45]
Per Ola Kristensson and Shumin Zhai. 2007. Learning shape writing by game playing. In Proceedings of the CHI’07 Extended Abstracts on Human Factors in Computing Systems (CHI EA’07). New York, NY: ACM, 1971–1976.
[46]
Gordon Kurtenbach and William Buxton. 1991. Issues in combining marking and direct manipulation techniques. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (UIST’91). New York, NY: ACM, 137–144.
[47]
Gordon Kurtenbach and William Buxton. 1994. User learning and performance with marking menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’94). New York, NY: ACM, 258–264.
[48]
Gordon Paul Kurtenbach. 1993. The Design and Evaluation of Marking Menus. Ph.D. Dissertation. University of Toronto, Toronto, ON, Canada.
[49]
Benjamin Lafreniere, Andrea Bunt, John Whissell, Charles L. A. Clarke, and Michael Terry. 2010. Characterizing large-scale use of a direct manipulation application in the wild. In Proceedings of Graphics Interface (GI’10). Canadian Information Processing Society, 11–18.
[50]
Richard N. Landers and Michael B. Armstrong. 2017. Enhancing instructional outcomes with gamification: An empirical test of the technology-enhanced training effectiveness model. Comput. Hum. Behav. 71, C (2017), 499--507.
[51]
David M. Lane, H. Albert Napier, S. Camille Peres, and Aniko Sandor. 2005. Hidden costs of graphical user interfaces: Failure to make the transition from menus and icon toolbars to keyboard shortcuts. Int. J. Hum.-Comput. Interact. 18, 2 (May 2005), 133–144.
[52]
Frank Linton, Deborah Joy, Hans-Peter Schaefer, and Andrew Charron. 2000. OWL: A recommender system for organization-wide learning. Educ. Technol. Soc. 3, 1 (2000), 62–76.
[53]
A. M. Machin. 2002. Planning, managing, and optimizing transfer of training. In Creating, Implementing, and Managing Effective Training and Development. San Francisco, CA: John Wiley 8 Sons, Inc., 263–301.
[54]
Sylvain Malacria, Gilles Bailly, Joel Harrison, Andy Cockburn, and Carl Gutwin. 2013a. Promoting hotkey use through rehearsal with exposeHK. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). New York, NY: ACM, 573–582.
[55]
Sylvain Malacria, Joey Scarr, Andy Cockburn, Carl Gutwin, and Tovi Grossman. 2013b. Skillometers: Reflective widgets that motivate and help users to improve performance. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST’13). New York, NY: ACM, 321–330.
[56]
Edgar Matias, I. Scott MacKenzie, and William Buxton. 1996. One-handed touch typing on a QWERTY keyboard. Hum.-Comput. Interact. 11, 1 (March 1996), 1–27.
[57]
Jane McGonigal. 2011. Reality is Broken: Why Games Make Us Better and How They can Change the World (Reprint ed.). New York: Penguin Books.
[58]
Allen Newell. 1990. Unified Theories of Cognition. Cambridge, MA: Harvard University Press.
[59]
Daniel L. Odell, Richard C. Davis, Andrew Smith, and Paul K. Wright. 2004. Toolglasses, marking menus, and hotkeys: A comparison of one and two-handed command selection techniques. In Proceedings of Graphics Interface (GI’04). Waterloo, ON, Canada: Canadian Human-Computer Communications Society, 17–24.
[60]
Thomas J. Peters and Robert H. Waterman Jr. 1982. In Search of Excellence: Lessons from America's Best-Run Companies, New York: HarperCollins Canada/Non-Fiction.
[61]
Philip Quinn. 2016. Economic Behaviour and Psychological Biases in Human–Computer Interaction. Ph.D. Dissertation. University of Canterbury.
[62]
Doug Rohrer, Kelli Taylor, Harold Pashler, John T. Wixted, and Nicholas J. Cepeda. 2005. The effect of overlearning on long-term retention. Appl. Cogn. Psychol. 19, 3 (April 2005), 361–374.
[63]
Janice Z. Rouiller and Irwin L. Goldstein. 1993. The relationship between organizational transfer climate and positive transfer of training. Hum. Resour. Dev. Q. 4, 4 (December 1993), 377–390.
[64]
Eduardo Salas and Janis A. Cannon-Bowers. 2001. The science of training: A decade of progress. Annu. Rev. Psychol. 52, 1 (February 2001), 471–499.
[65]
Joey Scarr, Andy Cockburn, Carl Gutwin, and Andrea Bunt. 2012. Improving command selection with CommandMaps. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). New York, NY: ACM, 257–266.
[66]
Joey Scarr, Andy Cockburn, Carl Gutwin, and Philip Quinn. 2011. Dips and ceilings: Understanding and supporting transitions to expertise in user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). New York, NY: ACM, 2741–2750.
[67]
Joey Scarr, Carl Gutwin, Andy Cockburn, and Andrea Bunt. 2015. StencilMaps and EphemeralMaps: Spatially stable interfaces that highlight command subsets. Behav. Inf. Technol. 34, 11 (November 2015), 1092–1106.
[68]
Richard A. Schmidt. 1991. Frequent augmented feedback can degrade learning: Evidence and interpretations. In Tutorials in Motor Neuroscience. Jean Requin and George E. Stelmach (Eds.), NATO ASI Series, Springer Netherlands, 59–75.
[69]
Richard Schmidt and Tim Lee. 2011. Motor Control and Learning: A Behavioral Emphasis (5th ed.). Champaign, IL: Human Kinetics.
[70]
Barry Schwartz, Ed Wasserman, and Steven J. Robbins. 2001. Psychology of Learning and Behaviour (5th ed.). New York: W. W. Norton 8 Company.
[71]
Chia Shen, Kathy Ryall, Clifton Forlines, Alan Esenther, Frederic D. Vernier, Katherine Everitt, Mike Wu, Daniel Wigdor, Meredith Ringel Morris, Mark Hancock, and Edward Tse. 2006. Informing the design of direct-touch tabletops. IEEE Comput. Graph. Appl. 26, 5 (September 2006), 36–46.
[72]
Mark K. Singley and John R. Anderson. 1989. The Transfer of Cognitive Skill. Cambridge, MA: Harvard University Press.
[73]
Josef H. Tubiana and Gershon Ben-Shakhar. 1982. An objective group questionnaire as a substitute for a personal interview in the prediction of success in military training in Israel. Pers. Psychol. 35, 2 (1982), 349–357.
[74]
Endel Tulving and Donald M. Thomson. 1973. Encoding specificity and retrieval processes in episodic memory. Psychol. Rev. 80, 5 (1973), 352–373.
[75]
William Vosburg. 2000. Factors Affecting the Transfer of Training from the Classroom to the Worksite. Ph.D. Dissertation. Vanderbilt University.
[76]
Tsung juang Wang. 2009. Educational benefits of multimedia skills training. TechTrends 54, 1 (December 2009), 47–57.
[77]
Xiaoqian Wang. 2010. Factors Influencing Knowledge and Skill Decay in Organizational Training: A Meta-Analysis. Ph.D. Dissertation. University of Oklahoma.
[78]
Kenneth N. Wexley and Timothy T. Baldwin. 1986. Posttraining strategies for facilitating positive transfer: An empirical exploration. Acad. Manage. J. 29, 3 (1986), 503–520.
[79]
Kenneth N. Wexley and Gary P. Latham. 2001. Developing and Training Human Resources in Organizations (3rd ed.). Upper Saddle River, NJ: Pearson.
[80]
R. S. Woodworth and E. L. Thorndike. 1901. The influence of improvement in one mental function upon the efficiency of other functions (I). Psychol. Rev. 8, 3 (1901), 247–261.
[81]
Mike Wu, Chia Shen, Kathy Ryall, Clifton Forlines, and Ravin Balakrishnan. 2006. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In Proceedings of the 1st IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’06). Washington, DC: IEEE Computer Society, 185–192.
[82]
Eldad Yechiam, Ido Erev, Vered Yehene, and Daniel Gopher. 2003. Melioration and the transition from touch-typing training to everyday use. Hum. Factors 45, 4 (Winter 2003), 671–684.
[83]
Shumin Zhai and Per-Ola Kristensson. 2003. Shorthand writing on stylus keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’03). New York, NY: ACM, 97–104.
[84]
Shumin Zhai, Alison Sue, and Johnny Accot. 2002. Movement model, hits distribution and learning in virtual keyboarding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). New York, NY: ACM, 17–24.

Cited By

View all
  • (2023)Maximizing Learner Engagement and Minimizing Transactional Distance With Positive Psychology InterventionsBecoming and Supporting Online Adjunct Faculty in a Gig Economy10.4018/978-1-6684-7776-2.ch007(120-145)Online publication date: 30-Jun-2023
  • (2022)Revisiting Menu Design Through the Lens of Implicit Statistical LearningProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531113(1-9)Online publication date: 6-Jun-2022
  • (2022)Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard HotkeysACM Transactions on Computer-Human Interaction10.1145/347651029:1(1-39)Online publication date: 7-Jan-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction
ACM Transactions on Computer-Human Interaction  Volume 24, Issue 4
August 2017
182 pages
ISSN:1073-0516
EISSN:1557-7325
DOI:10.1145/3132166
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 August 2017
Accepted: 01 June 2017
Revised: 01 June 2017
Received: 01 December 2016
Published in TOCHI Volume 24, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Novice to expert transitions
  2. expert interaction techniques
  3. training

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • Natural Sciences and Engineering Research Council of Canada

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)20
  • Downloads (Last 6 weeks)1
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Maximizing Learner Engagement and Minimizing Transactional Distance With Positive Psychology InterventionsBecoming and Supporting Online Adjunct Faculty in a Gig Economy10.4018/978-1-6684-7776-2.ch007(120-145)Online publication date: 30-Jun-2023
  • (2022)Revisiting Menu Design Through the Lens of Implicit Statistical LearningProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531113(1-9)Online publication date: 6-Jun-2022
  • (2022)Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard HotkeysACM Transactions on Computer-Human Interaction10.1145/347651029:1(1-39)Online publication date: 7-Jan-2022
  • (2022)Command SelectionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_19-1(1-35)Online publication date: 12-Mar-2022
  • (2020)Investigating the Influence of Interaction on Learning Persistence in Online Settings: Moderation or Mediation of Academic Emotions?International Journal of Environmental Research and Public Health10.3390/ijerph1707232017:7(2320)Online publication date: 30-Mar-2020
  • (2020)Side-Crossing MenusProceedings of the ACM on Human-Computer Interaction10.1145/34273174:ISS(1-19)Online publication date: 4-Nov-2020
  • (2020)Longer Delays in Rehearsal-based Interfaces Increase Expert UseACM Transactions on Computer-Human Interaction10.1145/341819627:6(1-41)Online publication date: 25-Nov-2020
  • (2020)Investigating Performance and Usage of Input Methods for Soft Keyboard Hotkeys22nd International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3379503.3403552(1-12)Online publication date: 5-Oct-2020
  • (2020)Manipulation, Learning, and Recall with Tangible Pen-Like InputProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376772(1-12)Online publication date: 21-Apr-2020
  • (2019)HotStrokesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300395(1-13)Online publication date: 2-May-2019
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media