Skip to main content

Advertisement

SpringerLink
Log in

RoboTIC: A serious game based on augmented reality for learning programming

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Coding skills are becoming more and more important in today’s world, especially within the context of the fourth industrial revolution. They also help practice other 21 century skills such as computational thinking, problem solving and teamwork. Unfortunately, learning how to program is tough and can be also frustrating for beginner students. In this work we introduce RoboTIC, a serious game based on gamification and Augmented Reality that facilitates the learning of programming to students in lower levels of the education system by using a novel set of visual metaphors derived from a notation of roads and traffic signs. The architecture that supports RoboTIC has been designed to allow the integration of multimedia components when new programming concepts and techniques must be addressed and to add game levels that enable students to learn incrementally. Experiments have been conducted in a youth center with children who do not have coding skills at all to demonstrate the feasibility of the proposal. The results show promising conclusions in terms of children’s motivation and interest in programming.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Abelson H, Goodman N, Rudolph L (1974) LOGO manual

  2. Bloem J, Van Doorn M, Duivestein S, Excoffier D, Maas R, Van Ommeren E (2014) The fourth industrial revolution. Things Tighten 8:1–40

    Google Scholar 

  3. Burgess N, Maguire EA, O’Keefe J (2002) The human hippocampus and spatial and episodic memory. Neuron 35(4):625–641

    Article  Google Scholar 

  4. Bacca J, Baldiris S, Fabregat R, Graf S (2014) Augmented reality trends in education:, A systematic review of research and applications. Educational Technology and Society 17(4):133–149

    Google Scholar 

  5. Basili VR, Caldiera G, Rombach HD (1994) The goal question metric approach. Encyclopedia of Software Engineering 2:528–532

    Google Scholar 

  6. BENTRAD S, Meslati D (2011) Visual programming and program visualization – towards an ideal visual software engineering system –. ACEEE International Journal on Information Technology 1:56–62

    Google Scholar 

  7. Colombo AW, Karnouskos S, Kaynak O, Shi Y, Yin S (2017) Industrial cyberphysical systems: a backbone of the fourth industrial revolution. IEEE Ind Electron Mag 11(1):6–16

    Article  Google Scholar 

  8. Connolly TM, Boyle EA, MacArthur E, Hainey T, Boyle JM (2012) A systematic literature review of empirical evidence on computer games and serious games. Computers & education 59(2):661–686

    Article  Google Scholar 

  9. Diehl S (2007) Software visualization: visualizing the structure, behaviour, and evolution of software. Springer Science & Business Media

  10. Dunleavy M, Dede C (2014). In: Spector JM, Merrill MD, Elen J, Bishop MJ (eds) Augmented reality teaching and learning, 4th eds. New York, Springer, pp 735–745

  11. da Silva Esteves AM, Santana ALM, Lyra R (2019) Use of augmented reality for computational thinking stimulation through virtual

  12. Davis FD (1993) User acceptance of information technology: system characteristics, user perceptions and behavioral impacts. International journal of man-machine studies 38(3):475–487

    Article  Google Scholar 

  13. Elshiekh R, Butgerit L (2017) Using gamification to teach students programming concepts. Open Access Library Journal 4(08):1

    Google Scholar 

  14. Eliasziw M, Donner A (1991) Application of the mcnemar test to non-independent matched pair data. Statistics in medicine 10(12):1981–1991

    Article  Google Scholar 

  15. Fraser N (2015) Ten things we’ve learned from Blockly. In: 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond), IEEE, pp 49–50

  16. Figueiredo M, Cifredo-Chacón MÁ, Gonçalves V (2016) Learning programming and electronics with augmented reality. In: International Conference on Universal Access in Human-Computer Interaction, Springer, pp 57–64

  17. Gallego-Durán FJ, Villagrá-Arnedo CJ, Llorens Largo F, Molina-Carmona R (2017) Plman: A game-based learning activity for teaching logic thinking and programming. International Journal of Engineering Education

  18. Gouws LA, Bradshaw K, Wentworth P (2013) Computational thinking in educational activities. In: Proceedings of the 18th ACM conference on Innovation and technology in computer science education - ITiCSE ’13, ACM Press, New York, New York, USA, pp 10

  19. Hidalgo-Céspedes J, Marín-Raventós G, Lara-villagrán V (2016) Learning principles in program visualizations: a systematic literature review. In: Proceedings of the 46th Annual Frontiers in Education (FIE) Conference. IEEE, pp 1–9

  20. Ibanez MB, Di-Serio A, Delgado-Kloos C (2014) Gamification for engaging computer science students in learning activities: a case study. IEEE Transactions on learning technologies 7(3):291–301

    Article  Google Scholar 

  21. Jee HK, Lim S, Youn J, Lee J (2014) An augmented reality-based authoring tool for e-learning applications. Multimedia Tools and Applications 68 (2):225–235

    Article  Google Scholar 

  22. Jimenez-Diaz G, Gonzalez-Calero PA, Gomez-Albarran M (2012) Role-play virtual worlds for teaching object-oriented design: the viRPlay development experience. Software:, Practice and Experience 42(2):235–253

    Google Scholar 

  23. Krpan D, Mladenović S, Ujević B (2018) Tangible programming with augmented reality. In: 12th International Technology, Education and Development Conference

  24. Kaye LK, Malone SA, Wall HJ (2017) Emojis: insights, affordances, and possibilities for psychological science. Trends Cogn Sci 21(2):66–68

    Article  Google Scholar 

  25. Kim TJ, Huh JH, Kim JM (2018) Bi-directional education contents using vr equipments and augmented reality. Multimedia Tools and Applications 77(22):30089–30104

    Article  Google Scholar 

  26. Kumar B, Khurana P (2012) Gamification in education-learn computer programming with fun. International Journal of Computers and Distributed Systems 2(1):46–53

    Google Scholar 

  27. Kaufmann H, Schmalstieg D (2002) Mathematics and geometry education with collaborative augmented reality. In: ACM SIGGRAPH 2002 conference abstracts and applications, pp 37–41

  28. Knight C, Munro M (2000) Virtual but visible software. In: Proceedings of the IEEE International Conference on Information Visualisation, pp 198–205 https://doi.org/10.1109/IV.2000.859756

  29. Majumdar A (2018) The hour of code: an initiative to break the barriers of coding. XRDS 24(3):12–13. https://doi.org/10.1145/3186711

    Article  Google Scholar 

  30. Myers BA (1990) Taxonomies of visual programming and program visualization. Journal of Visual Languages & Computing 1(1):97–123

    Article  MathSciNet  Google Scholar 

  31. Maloney J, Resnick M, Rusk N, Silverman B, Eastmond E (2010) The scratch programming language and environment. ACM Trans Comput Educ 10(4):1–15

    Article  Google Scholar 

  32. Milne I, Rowe G (2004) Ogre: Three-dimensional program visualization for novice programmers. Educ Inf Technol 9(3):219–237

    Article  Google Scholar 

  33. Mathur AS, Ozkan BK, Majumdar R (2018) Idea: An Immersive Debugger for Actors. In: Proceedings of the 17th ACM SIGPLAN International Workshop on Erlang, St. Louis, MO USA, ACM, pp 1–12

  34. Paliokas I, Arapidis C, Mpimpitsos M (2011) PlayLOGO 3D: A 3D Interactive Video Game for Early Programming Education: Let LOGO Be a Game. In: 2011 Third International Conference on Games and Virtual Worlds for Serious Applications, Athens, 2011, pp. 24–31. https://doi.org/10.1109/VS-GAMES.2011.10

  35. Parmar D, Isaac J, Babu SV, D’Souza N, Leonard AE, Jörg S, Gundersen K, Daily SB (2016) Programming moves: Design and evaluation of applying embodied interaction in virtual environments to enhance computational thinking in middle school students. In: 2016 IEEE Virtual Reality (VR). IEEE, pp 131–140

  36. Paliokas I, Arapidis C, Mpimpitsos M (2011) PlayLOGO 3D: A 3D Interactive Video Game for Early Programming Education: Let LOGO Be a Game. In: 2011 Third International Conference on Games and Virtual Worlds for Serious Applications,Athens, 2011, pp 24–31 https://doi.org/10.1109/VS-GAMES.2011.10

  37. Piteira M, Haddad SR (2011) Innovate in your program computer class. In: Proceedings of the 2011 Workshop on Open Source and Design of Communication - OSDOC ’11, ACM Press, New York. New York, USA, pp 49

  38. Robertson GG, Card SK, Mackinlay JD (1993) Information visualization using 3d interactive animation. Commun ACM 36(4):57–71

    Article  Google Scholar 

  39. Schwab K (2017) The fourth industrial revolution. Currency

  40. Sarkar SP, Sarker B, Hossain SA (2016) Cross platform interactive programming learning environment for kids with edutainment and gamification. In: 19Th international conference on computer and information technology, ICCIT, IEEE, pp 218–222

  41. Sajaniemi J, Kuittinen M (2003) Program animation based on the roles of variables. In: Proceedings of the 2003 ACM symposium on Software visualization, San Diego, California, USA, ACM, pp 7–ff

  42. Schez-Sobrino S, García MÁ, Gómez C, Vallejo D, Lacave C, Glez-Morcillo C, Molina AI, Albusac JA, Redondo MÁ (2019) ANGELA: A novel approach of graphic notation based on the metaphor of road signs to facilitate the learning of programming. In: Proceedings of the 7th International Conference on Technological Ecosystems for Enhancing Multiculturality

  43. Schez-Sobrino S, Gmez-Portes C, Vallejo D, Glez-Morcillo C, Redondo M A ́ (2020) An intelligent tutoring system to facilitate the learning of programming through the usage of dynamic graphic visualizations. Appl Sci 10(4):1518

    Article  Google Scholar 

  44. Teyseyre AR, Campo MR (2009) An overview of 3d software visualization. IEEE transactions on visualization and computer graphics 15(1):87–105

    Article  Google Scholar 

  45. Teng CH, Chen JY, Chen ZH (2018) Impact of augmented reality on programming language learning: Efficiency and perception. J Educ Comput Res 56(2):254–271

    Article  Google Scholar 

  46. Vahldick A, Mendes AJ, Marcelino MJ (2014) A review of games designed to improve introductory computer programming competencies. In: 2014 IEEE Frontiers in education conference (FIE) Proceedings. IEEE, pp 1–7

  47. Vasilopoulos IV, van Schaik P (2018) Koios: design, development, and evaluation of an educational visual tool for greek novice programmers. J Educ Comput Res, 0(0)

  48. Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2000) Experiment Process. pp 31–39

  49. Wald A, Wolfowitz J (1940) On a test whether two samples are from the same population. The Annals of Mathematical Statistics 11(2):147–162

    Article  MathSciNet  MATH  Google Scholar 

  50. Wing JM (2006) Computational thinking. Commun ACM 49 (3):33–35

    Article  Google Scholar 

  51. White R, Tian F, Smith P (2016). In: Code lab: a game that teaches high level programming languages. In: Proceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!, Poole. BCS Learning & Development Ltd., United Kingdom, pp 1–8, DOI https://doi.org/10.14236/ewic/HCI2016.76, (to appear in print)

Download references

Acknowledgements

This work has been funded by the Ministry of Economy, Industry and Competitiveness, and the European Regional Development Fund through the project TIN2015-66731-C2-2-R. The authors would like to thank Pablo Gutiérrez Caravantes for coordinating the experiments carried out in the youth center of Torralba in Calatrava (Ciudad Real, Spain) and the undergraduate students that participated in the project Telefónica Talentum for the development of the first software prototype.

Author information

Authors and Affiliations

  1. University of Castilla-La Mancha, Paseo de la Universidad 4, Ciudad Real, 13071, Spain

    Santiago Schez-Sobrino, David Vallejo, Carlos Glez-Morcillo, Miguel Á. Redondo & José Jesús Castro-Schez

Authors
  1. Santiago Schez-Sobrino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Vallejo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carlos Glez-Morcillo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Miguel Á. Redondo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. José Jesús Castro-Schez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Santiago Schez-Sobrino.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schez-Sobrino, S., Vallejo, D., Glez-Morcillo, C. et al. RoboTIC: A serious game based on augmented reality for learning programming. Multimed Tools Appl 79, 34079–34099 (2020). https://doi.org/10.1007/s11042-020-09202-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09202-z

Keywords

Search

Navigation