Skip to main content

Advertisement

SpringerLink
Log in

Decoupling assessment and serious games to support guided exploratory learning in smart education

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

This research proposes an enhanced approach of decoupling assessment and serious games to support fire evacuation training in smart education. The proposed assessment approach employs an evidence-based dynamic assessment and feedback to guide players through school’s building evacuation. Experimentation results show the applicability of the proposed assessment approach in enhancing fire evacuation training using serious games. Moreover, students were engaged to the proposed learning scenarios and their overall fire evacuation assessment were enhanced using the guided exploratory game-based training.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. http://www.thunderheadeng.com/pathfinder/

  2. http://www.elektraproject.org

  3. http://www.eightydays.eu

  4. http://unity3d.com

References

  • AL-Smadi M (2015) GAMEDUCATION: using gamification techniques to engage learners in online learning. Springer International Publishing, Cham

    Google Scholar 

  • AL-Smadi M, Guetl C (2011) Service-oriented flexible and interoperable assessment: towards a standardised e-assessment system. Int J Contin Eng Educ Life Long Lear 21(4):289–307

    Article  Google Scholar 

  • AL-Smadi M, Wesiak G, Guetl C (2012) Assessment in serious games: an enhanced approach for integrated assessment forms and feedback to support guided learning. In: 15th international conference on interactive collaborative learning (ICL), 2012. IEEE, pp 1–6

  • Almond R, Steinberg L, Mislevy R (2002) Enhancing the design and delivery of assessment systems: a four-process architecture. J Technol Learn Assess 1(5)

  • Andrée K, Nilsson D, Eriksson J (2015) Evacuation experiments in a virtual reality high-rise building: exit choice and waiting time for evacuation elevators. Fire Mater

  • Arosio G, Bagnara G, Capuano N, Fersini E, Toti D (2013) Ontology-driven data acquisition: intelligent support to legal ODR systems. In: JURIX, pp 25–28

  • Averill JD, Mileti DS, Peacock RD, Kuligowski ED, Groner N, Proulx G, Reneke PA, Nelson HE (2005) Federal building and fire safety investigation of the world trade center disaster occupant behavior, egress, and emergency communications. Tech. rep., National Institute of Standards and Technology, Washington, DC

  • Bloom BS, Engelhart MD (1969) Taxonomy of educational objectives: the classification of educational goals: by a Committee of College and University Examiners: handbook 1. David McKay

  • Bloomfield PR, Livingstone D (2009) Immersive learning and assessment with quizhud. Comput Inf Syst J 13(1):20–26

    Google Scholar 

  • Brooke J et al (1996) Sus-a quick and dirty usability scale. Usability Eval Ind 189(194):4–7

    Google Scholar 

  • Bukowski RW (2012) Addressing the needs of people using elevators for emergency evacuation. Fire Technol 48(1):127–136

    Article  Google Scholar 

  • Bunchball I (2010) Gamification 101: an introduction to the use of game dynamics to influence behavior. White paper

  • Burgos D, Moreno-Ger P, Sierra JL, Fernández-Manjón B, Specht M, Koper R (2008) Building adaptive game-based learning resources: The integration of IMS learning design and e-adventure. Simulation and Gaming

  • Capuano N, King R (2015) Knowledge-based assessment in serious games: an experience on emergency training. J e-Learn Knowl Soc 11(3)

  • Capuano N, Longhi A, Salerno S, Toti D (2015) Ontology-driven generation of training paths in the legal domain. Int J of Emerging Technol Learn 10(7):14–22

    Article  Google Scholar 

  • Chang M, et al. (2010) Web-based multiplayer online role playing game (morpg) for assessing students’ java programming knowledge and skills. In: Digital game and intelligent toy enhanced learning (DIGITEL), 2010 third IEEE international conference on, IEEE, pp 103–107

  • Chittaro L, Ranon R (2009) Serious games for training occupants of a building in personal fire safety skills. In: Games and virtual worlds for serious applications, 2009. VS-GAMES’09. Conference in, IEEE, pp 76–83

  • Connolly TM, Stansfield M, Hainey T (2011) An alternate reality game for language learning: arguing for multilingual motivation. Comput Educ 57(1):1389–1415

    Article  Google Scholar 

  • Dagger D, O’Connor A, Lawless S, Walsh E, Wade VP (2007) Service-oriented e-learning platforms: from monolithic systems to flexible services. IEEE Internet Comput 11(3):28–35

    Article  Google Scholar 

  • Davies WM, Davis HC (2005) Designing assessment tools in a service oriented architecture. In: 1st international ELeGI conference on advanced technology for enhanced learning, p 7

  • De Freitas S, Neumann T (2009) The use of exploratory learningfor supporting immersive learning in virtual environments. Comput Educ 52(2):343–352

    Article  Google Scholar 

  • De Freitas S, Oliver M (2005) A four dimensional framework for the evaluation and assessment of educational games. Comput Assist Learn

  • De Jong T, Van Joolingen WR (1998) Scientific discovery learning with computer simulations of conceptual domains. Rev Educ Res 68(2):179–201

    Article  Google Scholar 

  • Deterding S, Dixon D, Khaled R, Nacke L (2011) From game design elements to gamefulness: defining gamification. In: Proceedings of the 15th international academic MindTrek conference: envisioning future media environments, ACM, pp 9–15

  • Ding Y, Yang L (2013) Occupant evacuation process study of public buildings based on computer modeling and simulation. J Appl Fire Sci 23(3):365–380

    Article  Google Scholar 

  • Ding Y, Yang L, Weng F, Fu Z, Rao P (2015) Investigation of combined stairs elevators evacuation strategies for high rise buildings based on simulation. Simul Model Pract Theory 53:60–73

    Article  Google Scholar 

  • Dunwell I, de Freitas S, Jarvis S (2011) Four-dimensional consideration of feedback in serious games. In: de Freitas S, Maharg P (eds) Digital games and learning. Continuum Publishing, pp 42–62

  • Eseryel D, Ifenthaler D, Ge X (2011) Alternative assessment strategies for complex problem solving in game-based learning environments. In: Ifenthaler D, Michael Spector J, Isaias P, Sampson D, Kinshuk (eds) Multiple perspectives on problem solving and learning in the digital age. Springer, New York, pp 159–178

    Chapter  Google Scholar 

  • Fahy RF (1994) Exit 89-an evacuation model for high-rise buildings-model description and example applications. Fire Saf Sci 4:657–668

    Article  Google Scholar 

  • Fahy RF, Proulx G (2009) ’Panic’ and human behaviour in fire. pp 387–398

  • Fosnot CT, Perry RS (1996) Constructivism: a psychological theory of learning. In: Fosnot CT (ed) Constructivism: theory, perspectives, and practice. Teachers College Press, New York, pp 8–33

    Google Scholar 

  • Francis R, Saunders PB (1979) EVACNET: prototype network optimization models for building evacuation. National Bureau of Standards, Washington, DC

    Book  Google Scholar 

  • Friedler Y, Nachmias R, Linn MC (1990) Learning scientific reasoning skills in microcomputer-based laboratories. J Res Sci Teach 27(2):173–192

    Article  Google Scholar 

  • Girard C, Ecalle J, Magnan A (2013) Serious games as new educational tools: how effective are they? A meta-analysis of recent studies. J Comput Assist Learn 29(3):207–219

    Article  Google Scholar 

  • Glaser R, Schauble L, Raghavan K, Zeitz C (1992) Scientific reasoning across different domains. In: De Corte E, Linn M, Mandl H, Verschaffel L (eds) Computer-based learning environments and problem solving. Springer, Berlin, pp 345–373

    Chapter  Google Scholar 

  • Gwynne S, Galea E, Owen M, Lawrence PJ, Filippidis L (1999) A review of the methodologies used in the computer simulation of evacuation from the built environment. Build Environ 34(6):741–749

    Article  Google Scholar 

  • Hainey T, Connolly TM, Stansfield M, Boyle EA (2011) Evaluation of a game to teach requirements collection and analysis in software engineering at tertiary education level. Comput Educ 56(1):21–35

    Article  Google Scholar 

  • Hainey T, Connolly TM, Chaudy Y, Boyle E, Beeby R, Soflano M (2014) Assessment integration in serious games. In: Connolly TM, Hainey T, Boyle E, Baxter G, Moreno-Ger P (eds) Psychology, pedagogy, and assessment in serious games. IGI Global, Hershey, pp 317–341. doi:10.4018/978-1-4666-4773-2.ch015

    Chapter  Google Scholar 

  • Hunicke R, LeBlanc M, Zubek R (2004) Mda: A formal approach to game design and game research. In: Proceedings of the AAAI workshop on challenges in game AI, vol. 4, p 1

  • Ibáñez MB, Crespo RM, Kloos CD (2010) Assessment of knowledge and competencies in 3D virtual worlds: a proposal. In: Reynolds N, Turcsányi-Szabó M (eds) Key competencies in the knowledge society. Springer, Berlin, pp 165–176

    Chapter  Google Scholar 

  • Kemp JW, Livingstone D, Bloomfield PR (2009) Sloodle: connecting vle tools with emergent teaching practice in second life. Brh J Educ Technol 40(3):551–555

    Article  Google Scholar 

  • Kendik E (1986) Methods of design for means of egress: towards a quantitative comparison of national code requirements. Fire Saf Sci 1:497–511

    Article  Google Scholar 

  • Ketchell N, Cole S, Webber D, Marriott C, Stephens P, Brearley I, Fraser J, Dohney J, Smart J (1993) The EGRESS code for human movement and behaviour in emergency evacuations. University of Edinburgh, Artificial Intelligence Applications Institute

  • Kickmeier-Rust MD, Albert D (2010) Micro-adaptivity: protecting immersion in didactically adaptive digital educational games. J Comput Assist Learn 26(2):95–105

    Article  Google Scholar 

  • Kickmeier-Rust MD, Steiner CM, Albert D (2009) Non-invasive assessment and adaptive interventions in learning games. In: Intelligent networking and collaborative systems, 2009. INCOS’09. International conference on, IEEE, pp 301–305

  • Kisko TM, Francis R, Nobel C (1998) Evacnet4 users guide. University of Florida, Gainesville

    Google Scholar 

  • Kobes M, Helsloot I, De Vries B, Post JG (2010) Building safety and human behaviour in fire: a literature review. Fire Saf J 45(1):1–11

    Article  Google Scholar 

  • Kolb D (1984) Experiential learning: experience as the source of learning and development. Prentice Hall, Englewood Cliffs

    Google Scholar 

  • Korhonen T, Hostikka S (2009) Fire dynamics simulator with evacuation: Fds+ evac. Technical reference and users guide. VTT Technical Research Centre of Finland

  • Kuligowski ED, Gwynne SM (2010) The need for behavioral theory in evacuation modeling. In: Klingsch WWF, Rogsch C, Schadschneider A, Schreckenberg M (eds) Pedestrian and evacuation dynamics 2008. Springer, Berlin, pp 721–732

    Chapter  Google Scholar 

  • Lave J, Wenger E (1991) Situated learning: legitimate peripheral participation. Cambridge University Press, New York

    Book  Google Scholar 

  • MacDonald M (2003) Steps simulation of transient evacuation and pedestrian movements. User manual, Unpublished Work

  • Maderer J, Gütl C, Al-Smadi M (2013) Formative assessment in immersive environments: A semantic approach to automated evaluation of user behavior in open wonderland. J Immers Educ–Proceedings of iED 2013 Boston Summit, Boston

  • McAlpine M, van der Zanden L, Harris V, Authority SQ (2010) Using games based technology in formal assessment of learning. In: Proceedings of the 4th European conference on games-based learning: ECGBL2010, Academic Conferences Limited, p 242

  • Mislevy R, Riconscente M (2005) Evidence-centered assessment design: Layers, structures, and terminology (PADI technical report 9)

  • Mislevy RJ, Almond RG, Lukas JF (2004) A brief introduction to evidence-centered design. CSE report 632. US Department of Education

  • Moreno-Ger P, Burgos D, Martínez-Ortiz I, Sierra JL, Fernández-Manjón B (2008) Educational game design for online education. Comput Human Behav 24(6):2530–2540

    Article  Google Scholar 

  • Mory E (2006) Feedback research revisited.  In: Jonassen DH (ed) Handbook of research for educational communications and technology. Macmillan, New York, pp 745–783

  • Njoo M, De Jong T (1993) Exploratory learning with a computer simulation for control theory: learning processes and instructional support. J Res sci Teach 30(8):821–844

    Article  Google Scholar 

  • Raybourn EM (2007) Applying simulation experience design methods to creating serious game-based adaptive training systems. Interact Comput 19(2):206–214

    Article  Google Scholar 

  • Ribeiro J, Almeida JE, Rossetti RJ, Coelho A, Coelho AL (2012) Using serious games to train evacuation behaviour. In: Information systems and technologies (CISTI), 2012 7th Iberian Conference on, IEEE, pp 1–6

  • Rogers C (1951) Client-centered therapy: its current practice, implications and theory. Constable, London

    Google Scholar 

  • Ronchi E, Nilsson D (2013) Fire evacuation in high-rise buildings: a review of human behaviour and modelling research. Fire Sci Rev 2(1):1–21

    Article  Google Scholar 

  • Santos G, Aguirre BE (2004) A critical review of emergency evacuation simulation models. Tech. rep., National Institute of Standards and Technology, Washington, DC

  • Shute VJ (2008) Focus on formative feedback. Rev Educ Res 78(1):153–189

    Article  Google Scholar 

  • Shute VJ, Ventura M, Bauer M, Zapata-Rivera D (2009) Melding the power of serious games and embedded assessment to monitor and foster learning. Serious Games Mech Eff 2:295–321

    Google Scholar 

  • Sliney A, Murphy D (2008) Jdoc: a serious game for medical learning. In: Advances in computer–human interaction, 2008 first international conference on, IEEE, pp 131–136

  • Sliney A, Murphy D (2011) Using serious games for assessment. In: Ma M, Oikonomou A, Jain LC (eds) Serious games and edutainment applications. Springer, London, pp 225–243

    Chapter  Google Scholar 

  • Sliney A, Murphy D, O’Mullane J (2009) Secondary assessment data within serious games.  In: Petrovic O, Brand A (eds) Serious games on the move. Springer, Vienna, pp 225–233

    Google Scholar 

  • Swaak J, Van Joolingen WR, De Jong T (1998) Supporting simulation-based learning; the effects of model progression and assignments on definitional and intuitive knowledge. Learn Instr 8(3):235–252

    Article  Google Scholar 

  • Tan L, Hu M, Lin H (2015) Agent-based simulation of building evacuation: combining human behavior with predictable spatial accessibility in a fire emergency. Info Sci 295:53–66

    Article  MathSciNet  Google Scholar 

  • Underwood JS, Kruse S, Jakl P (2010) Moving to the next level: designing embedded assessments. In: Zemliansky P, Wilcox D (eds) Design and implementation of educational games: theoretical and practical perspectives. Information Science Network, Hersey, New York, pp 126–140

    Chapter  Google Scholar 

  • Veenman MV, Elshout JJ, Meijer J (1997) The generality vs domain-specificity of metacognitive skills in novice learning across domains. Learn Instr 7(2):187–209

    Article  Google Scholar 

  • Vygotsky LS (1986) Thought and language (revised edition, Kozulin A (ed)). MIT Press, Cambridge, MA

  • Williams-Bell F, Kapralos B, Hogue A, Murphy B, Weckman E (2015) Using serious games and virtual simulation for training in the fire service: a review. Fire Technol 51(3):553–584

    Article  Google Scholar 

  • Zhang W, Huang L, Wang B (2009) Application of the EVACNET4 model to evacuation in high-rise building. Fire Sci Technol 3:014

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Jordan University of Science and Technology, Irbid, Jordan

    Mohammad AL-Smadi

  2. Department of Information Engineering, Electric Engineering and Applied Mathematics, University of Salerno, Salerno, Italy

    Nicola Capuano

  3. Graz University of Technology, Graz, Austria

    Christian Guetl

  4. Curtin University, Perth, Western Australia, Australia

    Christian Guetl

Authors
  1. Mohammad AL-Smadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicola Capuano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christian Guetl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammad AL-Smadi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

AL-Smadi, M., Capuano, N. & Guetl, C. Decoupling assessment and serious games to support guided exploratory learning in smart education. J Ambient Intell Human Comput 9, 497–511 (2018). https://doi.org/10.1007/s12652-016-0436-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-016-0436-6

Keywords

Search

Navigation