Abstract
In this paper we present the design, development, application and validation of our skill mastery measurement software to help instructors adapt their instruction strategy to teach Visual AirCraft recognition (VACR) skill. Visual AirCraft recognition (VACR) is a critical skill required by soldiers operating surface-to-air missile defense systems to quickly recognize the aircraft and make engagement decisions. The current computer-based trainer to teach VACR has no intelligence to help instructors deliver personalized instructions or to track skill gaps. We compare our candidate automated support system that utilizes Dynamic Bayesian Network (DBN) models to measure skill progression to other conventional tutors and report our findings in terms of improved skill transfer and retention. The instruction delivery format incorporated in our automated support system is equivalent to Wings, Engine, Fuselage and Tail (WEFT) training that is provided by the instructors in a classroom setting. The goal of this study is to measure utility of our skill-tracking based automated system prior to its adoption by VACR instructors to impart WEFT training at Air Defense Artillery, Fort Sill, OK. We performed an Amazon Mechanical Turk (AMT) study to compare efficacy of our DBN-based VACR trainer with baseline and incremental tutors. The results indicate that our system increased overall transfer and retention performance of AMT participants by 19% and 16%, respectively compared to other tutors. We present the rationale behind design of these candidate tutors, implementation of DBN model for VACR and the AMT study design with final results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Anderson, J.: Acquisition of cognitive skill. Psychol. Rev. 89(4), 369–406 (1982)
Campbell, L.W.: An Intelligent Tutor System for Visual Aircraft Recognition. Master’s Thesis, Naval Postgraduate School, Monterey, CA (1990)
Corbett, A., Anderson, J.: Knowledge tracing: modeling the acquisition of procedural knowledge. User Model User Adapt. Interact. 4, 253–278 (1995)
Chein, M.J., Schneider, W.: Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. Cogn. Brain Res. 25, 607–623 (2005)
Delaney, P.F., Reder, L.M., Staszewski, J.J., Ritter, F.E.: The strategy specific nature of improvement: the power law applies by strategy within task. Psychol. Sci. 9(1), 1–8 (1998)
Hernandez-Meza, G., Slason, L., Ayaz, H., Craven, P., Oden, K., Izzetoglu, K.: Investigation of functional near infrared spectroscopy in evaluation of pilot expertise acquisition. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2015. LNCS (LNAI), vol. 9183, pp. 232–243. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20816-9_23
Juvina, I., et al.: Neurocognitive correlates of learning in a visual object recognition task. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2015. LNCS (LNAI), vol. 9183, pp. 256–267. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20816-9_25
Koedinger, K., Anderson, J.: Effective use of intelligent software in high school math classrooms. In: Brna, P., Ohlsson, S., Pan, H., (eds.) Proceedings of the world conference on Artificial Intelligence in Education. Charlottesville, VA: AACE, pp. 241–248 (1993)
Mason, W., Suri, S.: Conducting behavioral research on Amazon’s mechanical turk. Behav. Res. 44(1), 1–23 (2011)
MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, pp. 281–297 (1967)
Mayer, R.E. Technology and training. In: Blascovich, B.J., Hartel, C.R. (Eds.), Human Behavior in Military Contexts, pp. 39–45. Washington, DC: National Academies Press (2001)
The Bayes Net Toolbox for MATLAB. Computing Science & Statistics, 33. URL: https://code.google.com/p/bnt/. Assessed 12 Apr 2020
Murphy, K.P.: Dynamic Bayesian Networks: Representation, Inference and Learning, Ph.D. Thesis, UC Berkeley, Computer Science Division (2002)
National Research Council: In the mind’s eye: Enhancing Human Performance “Optimizing long-term learning and retention”, Druckman, D., Bjork, R., (eds.), pp. 23–52 (1992)
Newell, A., Rosenbloom, P.S.: Mechanisms of skill acquisition and the law of practice. In: Anderson, A.R. (ed.), Cognitive skills and their acquisition, pp. 1–55. Erlbaum press, New Jersey (1993)
Pliler, J.: Aircraft Recognition Training: A Continuing Process. Air Defense Artillery, HQDA PB 44–96–2, 15–17 (1996a)
Pliler, J.: VACR Goes Multimedia. Air Defense Artillery, HQDA PB 44–96–2, 17–20 (1996b).
Proctor, R.W., Dutta, A.: Skill Acquisition and Human Performance. Sage, Thousand Oaks (1995)
Tubbs, J., Deason, P., Evertt, E., Hansen, A.: CHAPARRAL training subsystem effectiveness analysis. In: Proceedings of 23rd Annual Conference of the Military Testing Association (1981)
VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46(4), 197–221 (2011)
Visual Aircraft Recognition (VACR) Field Manual, No. 3–01.80. http://armypubs.army.mil/doctrine/DR_pubs/dr_a/pdf/tc3_01x80.pdf . Accessed 02 Apr 2021
Van de Sande, B.: Properties of the Bayesian knowledge tracing model. J. Educ. Data Min. 5(2), 1–10 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ganapathy, P., Rangaraju, L.P., Kunapuli, G., Yadegar, J. (2021). Skill Mastery Measurement and Prediction to Adapt Instruction Strategies. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. Adaptation Strategies and Methods. HCII 2021. Lecture Notes in Computer Science(), vol 12793. Springer, Cham. https://doi.org/10.1007/978-3-030-77873-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-77873-6_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77872-9
Online ISBN: 978-3-030-77873-6
eBook Packages: Computer ScienceComputer Science (R0)