short-paper

A generalized, rapid authoring tool for intelligent tutoring systems

Authors:

Bradley Herbert,

Mark Billinghurst,

Amali Weerasinghe,

Grant WigleyAuthors Info & Claims

OzCHI '18: Proceedings of the 30th Australian Conference on Computer-Human Interaction

Pages 368 - 373

https://doi.org/10.1145/3292147.3292202

Published: 04 December 2018 Publication History

Abstract

As computer-based training systems become increasingly integrated into real-world training, tools which rapidly author courses for such systems are emerging. However, inconsistent user interface design and limited support for a variety of domains makes them time consuming and difficult to use. We present a Generalized, Rapid Authoring Tool (GRAT), which simplifies creation of Intelligent Tutoring Systems (ITSs) using a unified web-based wizard-style graphical user interface and programming-by-demonstration approaches to reduce technical knowledge needed to author ITS logic. We implemented a prototype, which authors courses for two kinds of tasks: A network cabling task and a console device configuration task to demonstrate the tool's potential. We describe the limitations of our prototype and present opportunities for evaluating the tool's usability and perceived effectiveness.

References

[1]

About: https://getbootstrap.com/docs/4.1/about/overview/. Accessed: 2018-08-16.

[2]

Ainsworth, S. and Grimshaw, S. 2004. Evaluating the REDEEM Authoring Tool: Can Teachers Create Effective Learning Environments? International Journal of Artificial Intelligence in Education (IOS Press). 14, 3/4 (Oct. 2004), 279--312.

Digital Library

[3]

Ainsworth, S., Major, N., Grimshaw, S., Hayes, M., Underwood, J., Williams, B. and Wood, D. 2003. REDEEM: Simple Intelligent Tutoring Systems from Usable Tools. Authoring Tools for Advanced Technology Learning Environments. Springer, Dordrecht. 205--232.

[4]

Aleven, V., McLaren, B.M. and Sewall, J. 2009. Scaling Up Programming by Demonstration for Intelligent Tutoring Systems Development: An Open-Access Web Site for Middle School Mathematics Learning. IEEE Transactions on Learning Technologies. 2, 2 (Apr. 2009), 64--78.

Digital Library

[5]

Aleven, V., McLaren, B.M., Sewall, J. and Koedinger, K.R. 2009. A New Paradigm for Intelligent Tutoring Systems: Example-Tracing Tutors. International Journal of Artificial Intelligence in Education. 19, 2 (Jan. 2009), 105--154.

Digital Library

[6]

Aleven, V., McLaren, B.M., Sewall, J. and Koedinger, K.R. 2006. The Cognitive Tutor Authoring Tools (CTAT): Preliminary evaluation of efficiency gains. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 4053 LNCS, (2006), 61--70.

Digital Library

[7]

Almiyad, M.A., Oakden-Rayner, L., Weerasinghe, A. and Billinghurst, M. 2017. Intelligent Augmented Reality Tutoring for Physical Tasks with Medical Professionals. Artificial Intelligence in Education (Jun. 2017), 450--454.

[8]

Baer, L.L., Duin, A.H., Norris, D. and Brodnick, R. 2013. Crafting Transformative Strategies for Personalized Learning/Analytics. Proceedings of the Third International Conference on Learning Analytics and Knowledge (New York, NY, USA, 2013), 275--277.

Digital Library

[9]

Brooke, J. 1996. SUS: A "quick and dirty" usability scale. Usability Evaluation in Industry. P.W. Jordan, B. Thomas, B.A. Weerdmeester, and I.L. McClelland, eds. Taylor and Francis. 189--227.

[10]

D'mello, S. and Graesser, A. 2013. AutoTutor and Affective Autotutor: Learning by Talking with Cognitively and Emotionally Intelligent Computers That Talk Back. ACM Trans. Interact. Intell. Syst. 2, 4 (Jan. 2013), 23:1--23:39.

Digital Library

[11]

Goldberg, B. and Cannon-Bowers, J. 2013. Experimentation with the generalized intelligent framework for tutoring (GIFT): a testbed use case. AIED 2013 Workshops Proceedings Volume (2013), 27--36.

[12]

Graesser, A. 2013. A guide to understanding learner models. Design Recommendations for Intelligent Tutoring Systems: Learner Modeling. 1, (2013), 3--6.

[13]

Herbert, B., Ens, B and Billinghurst, M. 2017. An Adaptive AR Tutor For Cabling a Network Topology. Eurographics Symposium on Virtual Environments (2017) (Adelaide, Australia, Oct. 2017).

Digital Library

[14]

Herbert, B., Ens, B., Weerasinghe, A., Billinghurst, M. and Wigley, G. 2018. Design considerations for combining augmented reality with intelligent tutors. Computers & Graphics. (Oct. 2018).

[15]

Herbert, B.M., Weerasinghe, A., Ens, B., Billinghurst, M. and Wigley, G. 2017. An AR Network Cabling Tutoring System for Wiring a Rack. The Eurographics Association.

Digital Library

[16]

Introduction to SignalR: 2014. https://docs.microsoft.com/enus/aspnet/signalr/overview/getting-started/introduction-to-signalr. Accessed: 2018-08-09.

[17]

Jovanovic, D. and Jovanovic, S. 2015. An adaptive e-learning system for Java programming course, based on Dokeos LE. Computer Applications in Engineering Education. 23, 3 (May 2015), 337--343.

Digital Library

[18]

Kodaganallur, V., Weitz, R.R. and Rosenthal, D. 2005. A Comparison of Model-Tracing and Constraint-Based Intelligent Tutoring Paradigms. International Journal of Artificial Intelligence in Education (IOS Press). 15, 2 (Jul. 2005), 117--144.

Digital Library

[19]

LaViola, J., Williamson, B., Brooks, C., Veazanchin, S., Sottilare, R. and Garrity, P. 2015. Using augmented reality to tutor military tasks in the wild. Interservice/Industry Training Simulation and Education Conference (Orlando, FL, USA, 2015), 1--10.

[20]

Major, N., Ainsworth, S. and Wood, D. 1997. REDEEM: Exploiting symbiosis between psychology and authoring environments. International Journal of Artificial Intelligence in Education. (1997), 317--340.

[21]

Mitrovic, A. 2003. An Intelligent SQL Tutor on the Web. International Journal of Artificial Intelligence in Education (IOS Press). 13, 2--4 (Jul. 2003), 173--197.

Digital Library

[22]

Mitrovic, A. 1998. Learning SQL with a Computerized Tutor. Proceedings of the Twenty-ninth SIGCSE Technical Symposium on Computer Science Education (New York, NY, USA, 1998), 307--311.

Digital Library

[23]

Mitrovic, A. 2010. Modeling Domains and Students with Constraint-Based Modeling. Advances in Intelligent Tutoring Systems. Springer, Berlin, Heidelberg. 63--80.

[24]

Mitrovic, A., Koedinger, K. and Martin, B. 2003. A comparative analysis of cognitive tutoring and constraint-based modeling. User Modeling 2003. (2003), 147--147.

Digital Library

[25]

Mitrovic, A., Martin, B., Suraweera, P., Zakharov, K., Milik, N., Holland, J. and McGuigan, N. 2009. ASPIRE: An Authoring System and Deployment Environment for Constraint-Based Tutors. International Journal of Artificial Intelligence in Education (IOS Press). 19, 2 (Jul. 2009), 155--188.

Digital Library

[26]

Mitrovic, A. and Ohlsson, S. 2006. A critique of kodaganallur, weitz and rosenthal, "a comparison of model-tracing and constraint-based intelligent tutoring paradigms." International Journal of Artificial Intelligence in Education. 16, 3 (2006), 277--289.

Digital Library

[27]

Mitrovic, A., Suraweera, P., Martin, B., Zakharov, K., Milik, N. and Holland, J. 2006. Authoring Constraint-Based Tutors in ASPIRE. Intelligent Tutoring Systems (Jun. 2006), 41--50.

Digital Library

[28]

Munro, A., Johnston, M.C., Pizzini, Q.A., Surmon, D.S., Towne, D.M. and Wogulis, J.L. 1997. Authoring Simulation-Centered Tutors with RIDES. International Journal of Artificial Intelligence in Education Society. 8, 2 (1997), 284--316.

[29]

Murray, T. 2003. An Overview of Intelligent Tutoring System Authoring Tools: Updated Analysis of the State of the Art. Authoring Tools for Advanced Technology Learning Environments. Springer, Dordrecht. 491--544.

[30]

Murray, T. 1999. Authoring Intelligent Tutoring Systems: An analysis of the state of the art. International Journal of Artificial Intelligence in Education (IJAIED). 10, (1999), 98--129.

[31]

Nesbit, J.C., Adesope, O.O., Liu, Q. and Ma, W. 2014. How Effective are Intelligent Tutoring Systems in Computer Science Education? 2014 IEEE 14th International Conference on Advanced Learning Technologies (Jul. 2014), 99--103.

Digital Library

[32]

Nye, B.D., Graesser, A.C. and Hu, X. 2014. AutoTutor and Family: A Review of 17 Years of Natural Language Tutoring. International Journal of Artificial Intelligence in Education. 24, 4 (Dec. 2014), 427--469.

[33]

Ososky, S., Brawner, K., Goldberg, B. and Sottilare, R. 2016. GIFT Cloud: Improving Usability of Adaptive Tutor Authoring Tools within a Web-based Application. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 60, 1 (Sep. 2016), 1389--1393.

[34]

Rajendran, D. 2011. Does Embedding an ICT Certification Help Align Tertiary Programs with Industry A Study of CCNA Workplace Perceptions. Journal of Applied Computing & Information Technology. 15, 1 (Jan. 2011), 1--6.

[35]

Roll, I., Aleven, V. and Koedinger, K.R. 2010. The Invention Lab: Using a Hybrid of Model Tracing and Constraint-Based Modeling to Offer Intelligent Support in Inquiry Environments. Intelligent Tutoring Systems (Jun. 2010), 115--124.

Digital Library

[36]

Sottilare, R., Brawner, K., Sinatra, A. and Johnston, J. 2017. An Updated Concept for a Generalized Intelligent Framework for Tutoring (GIFT). US Army Research Laboratory. (2017).

[37]

Sottilare, R., Hackett, M., Pike, W. and LaViola, J. 2017. Adaptive instruction for medical training in the psychomotor domain. The Journal of Defense Modeling and Simulation. 14, 4 (Oct. 2017), 331--343.

[38]

Sottilare, R. and LaViola, J. 2015. Extending intelligent tutoring beyond the desktop to the psychomotor domain: A Survey of smart glass technologies. Proceedings of the 2015 inter-service/industry training, simulation and education conference (Arlington, VA, 2015), 1--11.

[39]

Sottilare, R.A., Baker, R.S., Graesser, A.C. and Lester, J.C. 2017. Special Issue on the Generalized Intelligent Framework for Tutoring (GIFT): Creating a Stable and Flexible Platform for Innovations in AIED Research. International Journal of Artificial Intelligence in Education. (Sep. 2017), 1--13.

[40]

Sottilare, R.A., Brawner, K.W., Sinatra, A.M. and Johnston, J.H. 2017. An updated concept for a Generalized Intelligent Framework for Tutoring (GIFT). US Army Research Laboratory - Human Research & Engineering Directorate (ARL - HRED).

[41]

Sottilare, R.A., Goldberg, B.S., Brawner, K.W. and Holden, H.K. 2012. A modular framework to support the authoring and assessment of adaptive computer-based tutoring systems (CBTS). Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (2012), 1--13.

[42]

Sottilare, R.A. and Holden, H.K. 2013. Motivations for a generalized intelligent framework for tutoring (GIFT) for authoring, instruction and analysis. AIED 2013 Workshops Proceedings (2013), 1.

[43]

Stottler, R., Davis, A., Panichas, S. and Treadwell, M. 2007. Designing and Implementing Intelligent Tutoring Instruction for Tactical Action Officers. Maintainingt the Edge... Transforming The Force (San Mateo, CA, 2007), 11.

[44]

Sullivan, K. 1996. The Windows 95 User Interface: A Case Study in Usability Engineering. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 1996), 473--480.

Digital Library

[45]

Volder, K.D. 2006. JQuery: A Generic Code Browser with a Declarative Configuration Language. Practical Aspects of Declarative Languages (Jan. 2006), 88--102.

Digital Library

[46]

Westerfield, G. 2012. Intelligent Augmented Reality Training for Assembly and Maintenance. University of Canterbury.

Cited By

Papadimitriou SVirvou MPapadimitriou SVirvou M(2025)Authoring Intelligent Educational Games with Fuzzy ReasoningArtificial Intelligence—Based Games as Novel Holistic Educational Environments to Teach 21st Century Skills10.1007/978-3-031-77464-5_7(203-233)Online publication date: 21-Jan-2025
https://doi.org/10.1007/978-3-031-77464-5_7
Papadimitriou SVirvou MPapadimitriou SVirvou M(2025)Contributions and Discussions on Advancing 21st Century Skills Through EPATHLO: Prosocial Educational Games with Artificial IntelligenceArtificial Intelligence—Based Games as Novel Holistic Educational Environments to Teach 21st Century Skills10.1007/978-3-031-77464-5_10(277-309)Online publication date: 21-Jan-2025
https://doi.org/10.1007/978-3-031-77464-5_10

Index Terms

A generalized, rapid authoring tool for intelligent tutoring systems
1. Computing methodologies
  1. Artificial intelligence
2. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

An Interaction Design for Machine Teaching to Develop AI Tutors
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Intelligent tutoring systems (ITSs) have consistently been shown to improve the educational outcomes of students when used alone or combined with traditional instruction. However, building an ITS is a time-consuming process which requires specialized ...
Analysis and design of a web-based authoring tool generating intelligent tutoring systems

Authoring tools for intelligent tutoring systems (ITSs) are meant to provide environments where instructors may author their own ITSs in varying domains. In this way, painful constructions of ITSs, which are not reusable, may be avoided. However, the ...
Intelligent tutoring system authoring tools: the design characteristics

Research effort geared towards the construction of useful intelligent tutoring systems ITSs is fast growing. Sound and well-designed authoring tools or authoring systems play and will keep playing significant roles in realising the dream of making ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '18: Proceedings of the 30th Australian Conference on Computer-Human Interaction

December 2018

639 pages

ISBN:9781450361880

DOI:10.1145/3292147

Conference Chairs:
George Buchanan
The University of Melbourne
,
Duncan Stevenson
Australian National University

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 December 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Australian Government

Conference

OzCHI '18

OzCHI '18: 30th Australian Computer-Human Interaction Conference

December 4 - 7, 2018

Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
183
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)2

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Papadimitriou SVirvou MPapadimitriou SVirvou M(2025)Authoring Intelligent Educational Games with Fuzzy ReasoningArtificial Intelligence—Based Games as Novel Holistic Educational Environments to Teach 21st Century Skills10.1007/978-3-031-77464-5_7(203-233)Online publication date: 21-Jan-2025
https://doi.org/10.1007/978-3-031-77464-5_7
Papadimitriou SVirvou MPapadimitriou SVirvou M(2025)Contributions and Discussions on Advancing 21st Century Skills Through EPATHLO: Prosocial Educational Games with Artificial IntelligenceArtificial Intelligence—Based Games as Novel Holistic Educational Environments to Teach 21st Century Skills10.1007/978-3-031-77464-5_10(277-309)Online publication date: 21-Jan-2025
https://doi.org/10.1007/978-3-031-77464-5_10

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten