Skip to main content

Skill Mastery Measurement and Prediction to Adapt Instruction Strategies

  • Conference paper
  • First Online:
Adaptive Instructional Systems. Adaptation Strategies and Methods (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12793))

Included in the following conference series:

Abstract

In this paper we present the design, development, application and validation of our skill mastery measurement software to help instructors adapt their instruction strategy to teach Visual AirCraft recognition (VACR) skill. Visual AirCraft recognition (VACR) is a critical skill required by soldiers operating surface-to-air missile defense systems to quickly recognize the aircraft and make engagement decisions. The current computer-based trainer to teach VACR has no intelligence to help instructors deliver personalized instructions or to track skill gaps. We compare our candidate automated support system that utilizes Dynamic Bayesian Network (DBN) models to measure skill progression to other conventional tutors and report our findings in terms of improved skill transfer and retention. The instruction delivery format incorporated in our automated support system is equivalent to Wings, Engine, Fuselage and Tail (WEFT) training that is provided by the instructors in a classroom setting. The goal of this study is to measure utility of our skill-tracking based automated system prior to its adoption by VACR instructors to impart WEFT training at Air Defense Artillery, Fort Sill, OK. We performed an Amazon Mechanical Turk (AMT) study to compare efficacy of our DBN-based VACR trainer with baseline and incremental tutors. The results indicate that our system increased overall transfer and retention performance of AMT participants by 19% and 16%, respectively compared to other tutors. We present the rationale behind design of these candidate tutors, implementation of DBN model for VACR and the AMT study design with final results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, J.: Acquisition of cognitive skill. Psychol. Rev. 89(4), 369–406 (1982)

    Article  Google Scholar 

  • Campbell, L.W.: An Intelligent Tutor System for Visual Aircraft Recognition. Master’s Thesis, Naval Postgraduate School, Monterey, CA (1990)

    Google Scholar 

  • Corbett, A., Anderson, J.: Knowledge tracing: modeling the acquisition of procedural knowledge. User Model User Adapt. Interact. 4, 253–278 (1995)

    Article  Google Scholar 

  • Chein, M.J., Schneider, W.: Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. Cogn. Brain Res. 25, 607–623 (2005)

    Article  Google Scholar 

  • Delaney, P.F., Reder, L.M., Staszewski, J.J., Ritter, F.E.: The strategy specific nature of improvement: the power law applies by strategy within task. Psychol. Sci. 9(1), 1–8 (1998)

    Article  Google Scholar 

  • Hernandez-Meza, G., Slason, L., Ayaz, H., Craven, P., Oden, K., Izzetoglu, K.: Investigation of functional near infrared spectroscopy in evaluation of pilot expertise acquisition. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2015. LNCS (LNAI), vol. 9183, pp. 232–243. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20816-9_23

    Chapter  Google Scholar 

  • Juvina, I., et al.: Neurocognitive correlates of learning in a visual object recognition task. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2015. LNCS (LNAI), vol. 9183, pp. 256–267. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20816-9_25

    Chapter  Google Scholar 

  • Koedinger, K., Anderson, J.: Effective use of intelligent software in high school math classrooms. In: Brna, P., Ohlsson, S., Pan, H., (eds.) Proceedings of the world conference on Artificial Intelligence in Education. Charlottesville, VA: AACE, pp. 241–248 (1993)

    Google Scholar 

  • Mason, W., Suri, S.: Conducting behavioral research on Amazon’s mechanical turk. Behav. Res. 44(1), 1–23 (2011)

    Article  Google Scholar 

  • MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, pp. 281–297 (1967)

    Google Scholar 

  • Mayer, R.E. Technology and training. In: Blascovich, B.J., Hartel, C.R. (Eds.), Human Behavior in Military Contexts, pp. 39–45. Washington, DC: National Academies Press (2001)

    Google Scholar 

  • The Bayes Net Toolbox for MATLAB. Computing Science & Statistics, 33. URL: https://code.google.com/p/bnt/. Assessed 12 Apr 2020

  • Murphy, K.P.: Dynamic Bayesian Networks: Representation, Inference and Learning, Ph.D. Thesis, UC Berkeley, Computer Science Division (2002)

    Google Scholar 

  • National Research Council: In the mind’s eye: Enhancing Human Performance “Optimizing long-term learning and retention”, Druckman, D., Bjork, R., (eds.), pp. 23–52 (1992)

    Google Scholar 

  • Newell, A., Rosenbloom, P.S.: Mechanisms of skill acquisition and the law of practice. In: Anderson, A.R. (ed.), Cognitive skills and their acquisition, pp. 1–55. Erlbaum press, New Jersey (1993)

    Google Scholar 

  • Pliler, J.: Aircraft Recognition Training: A Continuing Process. Air Defense Artillery, HQDA PB 44–96–2, 15–17 (1996a)

    Google Scholar 

  • Pliler, J.: VACR Goes Multimedia. Air Defense Artillery, HQDA PB 44–96–2, 17–20 (1996b).

    Google Scholar 

  • Proctor, R.W., Dutta, A.: Skill Acquisition and Human Performance. Sage, Thousand Oaks (1995)

    Google Scholar 

  • Tubbs, J., Deason, P., Evertt, E., Hansen, A.: CHAPARRAL training subsystem effectiveness analysis. In: Proceedings of 23rd Annual Conference of the Military Testing Association (1981)

    Google Scholar 

  • VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46(4), 197–221 (2011)

    Article  Google Scholar 

  • Visual Aircraft Recognition (VACR) Field Manual, No. 3–01.80. http://armypubs.army.mil/doctrine/DR_pubs/dr_a/pdf/tc3_01x80.pdf . Accessed 02 Apr 2021

  • Van de Sande, B.: Properties of the Bayesian knowledge tracing model. J. Educ. Data Min. 5(2), 1–10 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Priya Ganapathy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ganapathy, P., Rangaraju, L.P., Kunapuli, G., Yadegar, J. (2021). Skill Mastery Measurement and Prediction to Adapt Instruction Strategies. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. Adaptation Strategies and Methods. HCII 2021. Lecture Notes in Computer Science(), vol 12793. Springer, Cham. https://doi.org/10.1007/978-3-030-77873-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77873-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77872-9

  • Online ISBN: 978-3-030-77873-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics