Skip to main content
SpringerLink
Log in

Development of a Test Battery for Cyber Soldiers

  • Conference paper
  • First Online:
HCI for Cybersecurity, Privacy and Trust (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12210))

Included in the following conference series:

  • 2865 Accesses

Abstract

There is a great need for people with specialist knowledge about cybersecurity in both the civil and military sector. The Swedish Armed Forces has decided that a basic education for conscript cyber soldiers shall be established. The work presented in this paper describes the development of an aptitude test for use in the selection process of conscript cyber soldiers, including a work analysis, test development, and initial validation. Based on the results from the work analysis and a literature review on other cyber tests, the test battery CyberTest Future Soldiers (CTFS) was developed. The cyber test (CTFS) consists of one skill test (with six subareas), one abilities test (with four subareas), and one survey regarding the test taker’s interests. The results from the initial validation show that the different test sections (skill and ability) measure different aspects important for performance. This lack of correlation makes it possible to select highly skilled people as well as people on a lower skill level, but who should perform well during the education due to their high level of abilities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Stockholms Handelskammare: Programmerare - vanligaste yrket i Stockholmsregionen, Stockholm (2014)

    Google Scholar 

  2. SCB: Trender och Prognoser 2017 (2017)

    Google Scholar 

  3. Freedberg, S.: Do young humans + artificial intelligence = cybersecurity? Intel Cyber Strategy Policy (2017). https://breakingdefense.com/2017/11/do-young-humans-artificial-intelligence-cybersecurity/

  4. Construx: Productivity Variations Among Software Developers and Teams The Origin of 10x | Construx. Construx (2019)

    Google Scholar 

  5. Johnson, W., te Nijenhuis, J., Bouchard, T.J.: Still just 1 g: consistent results from five test batteries. Intelligence 36(1), 81–95 (2008)

    Article  Google Scholar 

  6. Gardner, H.: Frames of Mind: The Theory of Multiple Intelligences. Basic Books, New York (2011)

    Google Scholar 

  7. Schmidt, F.L., Hunter, J.E.: The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol. Bull. 124(2), 262 (1998)

    Article  Google Scholar 

  8. Schmidt, F.L., Oh, I.-S., Shaffer, J.A.: the validity and utility of selection methods in personnel psychology: practical and theoretical implications of 100 years. Working Paper (2016)

    Google Scholar 

  9. McClelland, D.C.: Testing for Competence rather than for ‘intelligence’. Am. Psychol. 28(1), 1 (1973)

    Article  Google Scholar 

  10. Bennett, G., Seashore, H.G., Wesman, A.G.: Administrators’ Handbook for the Differential Aptitude Test (Forms V and W). Psychological Corp, New York (1982)

    Google Scholar 

  11. Carlstedt, B.: Begåvning, utbildningsval och utbildningsresultat | Pedagogisk Forskning i Sverige. Pedagog. Forsk. i Sverige 7(3), 168 (2002)

    Google Scholar 

  12. Annell, S.: Vilka sökande antas till och påbörjar polisutbildningen? Karlstad (2014)

    Google Scholar 

  13. Lantz, J., Wolgers, G.: Psykologiska tester och testanvändning i samband med psykologiskt urval av flygförare i Försvarsmakten 1944–2013: en sammanfattande historik och testöversikt (2013)

    Google Scholar 

  14. Goldberg, L.R.: The structure of phenotypic personality traits. Am. Psychol. 48(1), 26–34 (1993)

    Article  Google Scholar 

  15. John, O.P., Srivastava, S.: The big five trait taxonomy: history, measurement, and theoretical perspectives. In: Handbook of Personality: Theory and Research, pp. 102–138 (1999)

    Google Scholar 

  16. Barrick, M.R., Mount, M.K., Judge, T.A.: Personality and performance at the beginning of the new millennium: what do we know and where do we go next? Pers. Perform. 9(1/2), 9–30 (2001)

    Google Scholar 

  17. Salgado, J.F.: The five factor model of personality and job performance in the European community. J. Appl. Psychol. 82(1), 30–43 (1997)

    Article  Google Scholar 

  18. Sparks, C.P.: Testing for management potential. In: Clark, K.E., Clark, M.B. (eds.) Measures of Leadership, pp. 103–112. Center for Creative Leadership, Greensboro (1990)

    Google Scholar 

  19. Sitser, T., van der Linden, D., Born, M.P.: Predicting sales performance criteria with personality measures: the use of the general factor of personality, the big five and narrow traits. Hum. Perform. 26(2), 126–149 (2013)

    Article  Google Scholar 

  20. Morgeson, F., Campion, M., Dipboye, R., Hollenbeck, J., Murphy, K., Schmitt, N.: Are we getting fooled again? Coming to terms with limitations in the use of personality tests for personnel selection. Pers. Psychol. 60(4), 1029–1049 (2007)

    Article  Google Scholar 

  21. Morgeson, F.P., Campion, M.A., Dipboye, R.L., Hollenbeck, J.R., Murphy, K., Schmitt, N.: Reconsidering the use of personality tests in personnel selection contexts (2007)

    Google Scholar 

  22. ChallyGroup: The Trouble with Personality Tests, Larkspur, CA (2011)

    Google Scholar 

  23. Saner, L.D., Campbell, S., Bradley, P., Michael, E., Pandza, N., Bunting, M.: Assessing aptitude and talent for cyber operations. In: Nicholson, D. (ed.) Advances in Human Factors in Cybersecurity. Advances in Intelligent Systems and Computing, vol. 501, pp. 431–437. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-41932-9_35

    Chapter  Google Scholar 

  24. Newhouse, B., Keith, S., Scribner, B., Witte, G.: National Initiative for Cybersecurity Eduction (NICE) cybersecurity workforce framework, Gaithersburg, MD, USA (2017)

    Google Scholar 

  25. National Initiative for Cybersecurity Careers and Studies: NICE Cybersecurity Workforce Framework | National Initiative for Cybersecurity Careers and Studies. Department of Homeland Security (2018)

    Google Scholar 

  26. Napolitano, J.: Homeland security advisory council cyberskills task force report (2012)

    Google Scholar 

  27. IBM: Defense Cyber Aptitude Test (DCAT). IBM (2018)

    Google Scholar 

  28. Cambell, S., O’Rourke, P., Bunting, M.: Identifying dimensions of cyber aptitude: the design of the cyber aptitude and talent assessment. In: Human Factors and Egonomics Society 59th Annual Meeting, pp. 721–725 (2015)

    Google Scholar 

  29. ArmedForces: Navy Rating ASVAB Score Requirements. U.S. Armed Forces (2018)

    Google Scholar 

  30. Morris, J., Waage, F.: Cyber aptitude assessment-finding the next generation of enlisted cyber soldiers (2015)

    Google Scholar 

  31. Stanton, N.A., Salmon, P.R., Walker, G.B., Jenkins, D.: Human Factors Methods: A Practical Guide for Engineering and Design. Ashgate Publishing Limited, Surrey (2013)

    Google Scholar 

  32. Lif, P., Granasen, M., Sommestad, T.: Development and validation of technique to measure cyber situation awareness. In: 2017 International Conference On Cyber Situational Awareness, Data Analytics And Assessment (Cyber SA), pp. 1–8 (2017)

    Google Scholar 

  33. Moses, T.: A Review of developments and applications in item analysis. In: Bennett, R., von Davier, M. (eds.) Advancing Human Assessment. Methodology of Educational Measurement and Assessment, pp. 19–46. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58689-2_2

    Chapter  Google Scholar 

  34. Understanding Item Analyses | Office of Educational Assessment. https://www.washington.edu/assessment/scanning-scoring/scoring/reports/item-analysis/. Accessed 07 Oct 2019

  35. Kehoe, J.: Basic item analysis for multiple-choice tests. Pract. Assess. Res. Eval. 4(10) (1995)

    Google Scholar 

  36. Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3/4), 591 (1965)

    Article  MathSciNet  Google Scholar 

  37. Field, A., Miles, J., Field, Z.: Discovering Statistics Using R. Sage Publications Inc., London (2012)

    Google Scholar 

  38. Bureau of Labor Statistics: Software Developers : Occupational Outlook Handbook: U.S. Bureau of Labor Statistics. United States Department of Labor (2019)

    Google Scholar 

  39. SANS: SANS Cyber Security Certifications & Research. SANS (2018). https://www.sans.org/. Accessed 23 Nov 2018

  40. Sommestad, T.: STO-MP-IST-133 Experimentation on operational cyber security in CRATE (2015)

    Google Scholar 

  41. Holm, H., Sommestad, T.: SVED: scanning, vulnerabilities, exploits and detection. In: MILCOM 2016 - 2016 IEEE Military Communications Conference, pp. 976–981 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Swedish Defence Research Agency, Linköping, Sweden

    Patrik Lif, Jacob Löfvenberg, Per Wikberg & Ove Jansson

Authors
  1. Patrik Lif
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jacob Löfvenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Per Wikberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ove Jansson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Patrik Lif , Jacob Löfvenberg , Per Wikberg or Ove Jansson .

Editor information

Editors and Affiliations

  1. San Jose State University, San Jose, CA, USA

    Abbas Moallem

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lif, P., Löfvenberg, J., Wikberg, P., Jansson, O. (2020). Development of a Test Battery for Cyber Soldiers. In: Moallem, A. (eds) HCI for Cybersecurity, Privacy and Trust. HCII 2020. Lecture Notes in Computer Science(), vol 12210. Springer, Cham. https://doi.org/10.1007/978-3-030-50309-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50309-3_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50308-6

  • Online ISBN: 978-3-030-50309-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation