Roberto Andreoli
Vittorio Scarano
Skip Abstract Section
Abstract
Video games and their design are complex in nature, given the variety of aspects and challenges to face and the different areas of expertise involved. Furthermore, serious games have an even tougher challenge, since the knowledge acquisition has the same importance and relevance as entertainment and pleasure for the players. Serious games in cultural heritage require additional effort to introduce immersivity and collaboration among players.
This article introduces a framework, named FRACH, to conceive, design, and evaluate immersive and collaborative serious games in cultural heritage. In particular, FRACH provides a design framework with steps to follow during the whole process that is from the early design phase to the evaluation phase of a serious game.
We assessed the efficacy of our framework, with a specific case study in cultural heritage, by implementing a section of a serious game named HippocraticaCivitasGame, where players were allowed to visit the thermae of the historical site of San Pietro a Corte and Palazzo Fruscione in the city of Salerno, Italy, and to solve a given puzzle. Results of the game evaluation showed that the game was effective in terms of knowledge acquisition, the participants enjoyed the game, were highly involved in the immersive experience, and, finally, positively rated the idea of using the game for educational learning in the field of cultural heritage.
- Ernest Adams. 2013. Fundamentals of Game Design. Pearson Education, London, United Kingdom. Google Scholar
Digital Library
- Alan Amory. 2007. Game object model version II: A theoretical framework for educational game development. Educ. Technol. Res. Dev. 55, 1 (2007), 51--77.Google ScholarCross Ref
- Roberto Andreoli, Angela Corolla, Armando Faggiano, Delfina Malandrino, Donato Pirozzi, Mirta Ranaldi, Gianluca Santangelo, and Vittorio Scarano. 2016. Immersivity and playability evaluation of a game experience in cultural heritage. In Proceedings of the 6th International Conference on Digital Heritage, EuroMed 2016. 814--824.Google ScholarCross Ref
- Eike F. Anderson, Leigh McLoughlin, Fotis Liarokapis, Christopher Peters, Panagiotis Petridis, and S. de Freitas. 2009. Serious games in cultural heritage. In International 10th VAST Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST'09). 29--48.Google Scholar
- Eike Falk Anderson, Leigh McLoughlin, Joe Watson, Sam Holmes, Peter Jones, Hayden Pallett, and Brendan Smith. 2013. Choosing the infrastructure for entertainment and serious computer games-a whiteroom benchmark for game engine selection. In Proceedings of the 2013 5th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES’13). IEEE, 1--8.Google ScholarCross Ref
- Angeliki Antoniou, George Lepouras, Stavroula Bampatzia, and Hera Almpanoudi. 2013. An approach for serious game development for cultural heritage: Case study for an archaeological site and museum. J. Comput. Cult. Herit. 6, 4, Article 17 (Dec. 2013), 19 pages. Google ScholarDigital Library
- Sylvester Arnab, Theodore Lim, Maira B. Carvalho, Francesco Bellotti, Sara de Freitas, Sandy Louchart, Neil Suttie, Riccardo Berta, and Alessandro De Gloria. 2015. Mapping learning and game mechanics for serious games analysis. Br. J. Educ. Technol. 46, 2 (2015), 391--411.Google ScholarCross Ref
- Per Backlund and Maurice Hendrix. 2013. Educational games-are they worth the effort? A literature survey of the effectiveness of serious games. In Proceedings of the 2013 5th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES’13). 1--8.Google ScholarCross Ref
- Francesco Bellotti, Riccardo Berta, Alessandro De Gloria, Annamaria D’ursi, and Valentina Fiore. 2012. A serious game model for cultural heritage. J. Comput. Cult. Herit. (JOCCH) 5, 4 (2012), 17. Google ScholarDigital Library
- Francesco Bellotti, Riccardo Berta, Alessandro De Gloria, and Ludovica Primavera. 2010. Supporting authors in the development of task-based learning in serious virtual worlds. Br. J. Educ.l Technol. 41, 1 (2010), 86--107.Google Scholar
- Elizabeth A. Boyle, Thomas Hainey, Thomas M. Connolly, Grant Gray, Jeffrey Earp, Michela Ott, Theodore Lim, Manuel Ninaus, Claudia Ribeiro, and Joo Pereira. 2016. An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Comput. Educ. 94 (2016), 178--192. Google ScholarDigital Library
- Jeanne H. Brockmyer, Christine M. Fox, Kathleen A. Curtiss, Evan McBroom, Kimberly M. Burkhart, and Jacquelyn N. Pidruzny. 2009. The development of the game engagement questionnaire: A measure of engagement in video game-playing. J. Exp. Soc. Psychol. 45, 4 (2009), 624--634.Google ScholarCross Ref
- J. Brooke. 1996. SUS: A quick and dirty usability scale. In Usability Evaluation in Industry, P. W. Jordan, B. Weerdmeester, A. Thomas, and I. L. Mclelland (Eds.). Taylor and Francis, London.Google Scholar
- Alejandro Calderón and Mercedes Ruiz. 2015. A systematic literature review on serious games evaluation: An application to software project management. Comput. Educ. 87 (2015), 396--422. Google ScholarDigital Library
- Maira B. Carvalho, Francesco Bellotti, Riccardo Berta, Alessandro De Gloria, Carolina Islas Sedano, Jannicke Baalsrud Hauge, Jun Hu, and Matthias Rauterberg. 2015. An activity theory-based model for serious games analysis and conceptual design. Comput. Educ. 87 (2015), 166--181. Google ScholarDigital Library
- John P. Chin, Virginia A. Diehl, and Kent L. Norman. 1988. Development of an instrument measuring user satisfaction of the human-computer interface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 213--218. Google ScholarDigital Library
- Luca Chittaro and Fabio Buttussi. 2015. Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety. IEEE Trans. Vis. Comput. Graph. 21, 4 (2015), 529--538.Google ScholarDigital Library
- Georgios Christou. 2014. The interplay between immersion and appeal in video games. Comput. Hum. Behav. 32 (2014), 92--100.Google ScholarDigital Library
- Thomas M. Connolly, Elizabeth A. Boyle, Ewan MacArthur, Thomas Hainey, and James M. Boyle. 2012. A systematic literature review of empirical evidence on computer games and serious games. Computers 8 Education 59, 2 (2012), 661--686. Google ScholarDigital Library
- Edgar Dale. 1969. Audiovisual methods in teaching. Dryden Press, New York, USA.Google Scholar
- Fred D. Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13, 3 (Sept. 1989), 319--340. Google ScholarDigital Library
- Hugh Denard. 2012. A new introduction to the london charter. Paradata and Transparency in Virtual Heritage (2012), 57--72.Google Scholar
- Sebastian Deterding. 2012. Gamification: Designing for motivation. Interactions 19, 4 (2012), 14--17. Google ScholarDigital Library
- Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. From game design elements to gamefulness: Defining gamification. In International Academic MindTrek Conference: Envisioning Future Media Environments. 9--15. Google ScholarDigital Library
- Joris Dormans et al. 2012. Engineering Emergence: Applied Theory for Game Design. Creative Commons.Google Scholar
- John H. Falk and Lynn D. Dierking. 2012. The Museum Experience Revisited. Routledge, Abingdon on Thames, United Kingdom.Google Scholar
- Andrew Fish, Claudio Gargiulo, Delfina Malandrino, Donato Pirozzi, and Vittorio Scarano. 2016. Visual exploration system in an industrial context. IEEE Trans. Ind. Inform. 12, 2 (2016), 567--575.Google ScholarCross Ref
- J. Froschauer, M. Arends, D. Goldfarb, and D. Merkl. 2012. A serious heritage game for art history: Design and evaluation of ThIATRO. In Proceedings of the 2012 18th International Conference on Virtual Systems and Multimedia (VSMM’12). 283--290.Google Scholar
- J. Froschauer, I. Seidel, M. Grtner, H. Berger, and D. Merkl. 2010. Design and evaluation of a serious game for immersive cultural training. In Virtual Systems and Multimedia (VSMM’10). 253--260.Google Scholar
- Lilia García-Mundo, Marcela Genero, and Mario Piattini. 2015. Towards a construction and validation of a serious game product quality model. In Games and Virtual Worlds for Serious Applications (VS-Games’15). IEEE, 1--8.Google Scholar
- James Paul Gee. 2009. Serious Games: Mechanisms and Effects. Routledge, Taylor and Francis Group, Chapter Deep Learning properties of Good Video Games: How Far Can They Go? 67--82.Google Scholar
- Yohnosuke Harada, Kiyoshi Nosu, and Naohito Okude. 1999. Interactive and collaborative learning environment using 3D virtual reality content, multi-screen display and PCs. In Proceedings of the IEEE 8th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises. 238--244. Google ScholarDigital Library
- Marc Hassenzahl and Andrew Monk. 2010. The inference of perceived usability from beauty. Hum. Comput. Interact 25, 3 (2010), 235--260.Google ScholarCross Ref
- Niklas Henriks. 2007. Creating serious games by integrating external components in commercial game engines: Propositions and guidelines for future work with serious games. http://www.diva-portal.org/smash/get/diva2:2461/FULLTEXT01.pdf.Google Scholar
- Daniel Hickmott, Shamus P. Smith, Ross Bille, Elizabeth Burd, Liz Stephens, and Erica Southgate. 2016. Building apostrophe power: Lessons learnt for serious games development. In Proceedings of the Australasian Computer Science Week Multiconference. 70. Google ScholarDigital Library
- Jane L. Howland, David H. Jonassen, and Rose M. Marra. 2008. Meaningful Learning with Technology. Pearson, United Kingdom.Google Scholar
- Isabelle Hupont, Joaquin Gracia, Luis Sanagustín, and Miguel Angel Gracia. 2015. How do new visual immersive systems influence gaming QoE? A use case of serious gaming with oculus rift. In Proceedings of the 2015 7th International Workshop on Quality of Multimedia Experience (QoMEX’15). 1--6.Google ScholarCross Ref
- ICOMOS. 1996. Principles for the recording of monuments, groups of buildings and sites. ICOMOS (1996).Google Scholar
- ISO/IEC-25010. 2011. ISO/IEC 25010: Systems and Software Engineering—Systems and Software Quality Requirements and Evaluation (SQuaRE)—System and Software Quality Models, ISO (International Organization for Standardization). (2011).Google Scholar
- Jeffrey Jacobson. 2008. Ancient Architecture in Virtual Reality: Does immersion really aid learning? Ph.D. Dissertation. Doctoral Thesis, School of Information Science, University of Pittsburgh, Pennsylvania.Google Scholar
- Jeffrey Jacobson, Kerry Handron, and Lynn Holden. 2009. Narrative and content combine in a learning game for virtual heritage. Distance Educ. 9, 2 (2009), 7--26.Google Scholar
- Jeffrey Jacobson and Michael Lewis. 2005. Game engine virtual reality with CaveUT. Computer 38, 4 (2005), 79--82. Google ScholarDigital Library
- Charlene Jennett, Anna L. Cox, Paul Cairns, Samira Dhoparee, Andrew Epps, Tim Tijs, and Alison Walton. 2008. Measuring and defining the experience of immersion in games. Int. J. Hum.-Comput. Studies 66, 9 (2008), 641--661. Google ScholarDigital Library
- Ira H. Bernstein and Jum C. Nunnally. 1994. Psychometric Theory. McGraw-Hill.Google Scholar
- Yasmin B. Kafai and Yasmin Bettina Kafai. 1995. Minds in Play: Computer Game Design as a Context for Children’s Learning. Routledge, Abingdon on Thames, United Kingdom. Google ScholarDigital Library
- Roy S. Kalawsky. 2000. The validity of presence as a reliable human performance metric in immersive environments. In Proceedings of the 3rd International Workshop on Presence. 27--28.Google Scholar
- Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3, 3 (1993), 203--220.Google ScholarCross Ref
- Richard N. Landers. 2014. Developing a theory of gamified learning linking serious games and gamification of learning. Simul. Gaming 45, 6 (2014), 752--768. Google ScholarDigital Library
- Jane Lessiter, Jonathan Freeman, Edmund Keogh, and Jules Davidoff. 2001. A cross-media presence questionnaire: The ITC-sense of presence inventory. Presence: Teleoper. Virtual Environ. 10, 3 (June 2001), 282--297. Google ScholarDigital Library
- James R. Lewis. 1995. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Int. 7, 1 (Jan. 1995), 57--78. Google ScholarDigital Library
- Michael Lewis and Jeffrey Jacobson. 2002. Game engines. Commun. ACM 45, 1 (2002), 27.Google ScholarDigital Library
- London Charter. 2009. The london charter for the use of 3D visualisation in the research and communication of cultural heritage (2009). Accessed on November, 16 2017. http://www.londoncharter.org.Google Scholar
- Delfina Malandrino, Ilaria Manno, Giuseppina Palmieri, Vittorio Scarano, and Giovanni Filatrella. 2014. How quiz-based tools can improve students’ engagement and participation in the classroom. In 2014 International Conference on Collaboration Technologies and Systems, (CTS’14). 379--386.Google ScholarCross Ref
- Delfina Malandrino, Vittorio Scarano, and Raffaele Spinelli. 2013. How increased awareness can impact attitudes and behaviors toward online privacy protection. In Proceedings of the International Conference on Social Computing, (SocialCom’13), Washington DC. 57--62. Google ScholarDigital Library
- Iza Marfisi-Schottman, Aymen Sghaier, Sébastien George, Franck Tarpin-Bernard, and Patrick Prévôt. 2009. Towards industrialized conception and production of serious games. preprint arXiv:0911.4262 (2009).Google Scholar
- M. David Merrill. 2002. First principles of instruction. Educ. Technol. Res. Dev. 50, 3 (2002), 43--59.Google ScholarCross Ref
- M. David Merrill. 2008. Converting e3-learning to e3-learning: An alternative instructional design method. The e-Learning Handbook: A Comprehensive Guide to Online Learning (2008), 359--400.Google Scholar
- M. David Merrill. 2009. Finding e3 (effective, efficient, and engaging) instruction. Educ. Technol. 49, 3 (2009), 15.Google Scholar
- Christiane Moser, Verena Fuchsberger, and Manfred Tscheligi. 2012. Rapid assessment of game experiences in public settings. In Proceedings of the 4th International Conference on Fun and Games (FnG’12). 73--82. Google ScholarDigital Library
- Allan Nevins. 1954. New lamps for old in history. The Am. Archivist 17, 1 (1954), 3--12.Google ScholarCross Ref
- Franco Niccolucci. 2002. Virtual archaeology: An introduction. In Virtual Archaeology: Proceedings of the VAST Euroconference, Arezzo 24-25 November 2000. Archaeopress, 3--6.Google Scholar
- Michela Ott and Francesca Pozzi. 2011. Towards a new era for cultural heritage education: Discussing the role of ICT. Comput. Hum. Behav. 27, 4 (2011), 1365--1371. Google ScholarDigital Library
- Seymour Papert and Idit Harel. 1991. Situating constructionism. Constructionism 36 (1991), 1--11.Google Scholar
- Paolo Peduto, Rosa Fiorillo, and Angela Corolla. 2013. Salerno. Una Sede Ducale Della Langobardia Meridionale. Spoleto: CISAM.Google Scholar
- Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic mapping studies in software engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering (EASE’08). 68--77. Google ScholarDigital Library
- Panagiotis Petridis, Ian Dunwell, David Panzoli, Sylvester Arnab, Aristidis Protopsaltis, Maurice Hendrix, and Sara de Freitas. 2012. Game engines selection framework for high-fidelity serious applications. J. Interact. Worlds 2012 (2012), 1.Google ScholarCross Ref
- De Prisco, Roberto, Delfina Malandrino, Donato Pirozzi, Gianluca Zaccagnino, and Rocco Zaccagnino. 2017. Understanding the structure of musical compositions: Is visualization an effective approach? Information Visualization 16, 2 (2017), 139--152.Google ScholarCross Ref
- Paul Reilly. 1992. Three-dimensional modelling and primary archaeological data. In Archaeology and the Information Age: A Global Perspective. Routledge, Abingdon on Thames, United Kingdom, 147--176.Google Scholar
- Scott Rogers. 2014. Level Up! The Guide to Great Video Game Design. John Wiley 8 Sons, United States. Google ScholarDigital Library
- Bill Roungas. 2016. A model-driven framework for educational game design. Int. J. Serious Games 3, 3 (2016), 19--37.Google ScholarCross Ref
- Irene Rubino, Claudia Barberis, Jetmir Xhembulla, and Giovanni Malnati. 2015. Integrating a location-based mobile game in the museum visit: Evaluating visitors’behaviour and learning. J. Comput. Cult. Herit. 8, 3 (May 2015), Article 15, 18 pages. Google ScholarDigital Library
- Seville Charter. 2010. The seville charter: International charter for virtual archaeology (2010). Accessed on November, 16 2017. www.arqueologiavirtual.com/carta.Google Scholar
- Mel Slater, Pankaj Khanna, Jesper Mortensen, and Insu Yu. 2009. Visual realism enhances realistic response in an immersive virtual environment. IEEE Comp. Graph. Appl. 29, 3 (2009), 76--84.Google ScholarDigital Library
- Ludovico Solima and Alessandro Bollo. 2002. I Musei e le Imprese: Indagine Sui Servizi Di Accoglienza Nei Musei Statali Italiani. Electa Napoli.Google Scholar
- Jason Tan, Chris Beers, Ruchi Gupta, and Gautam Biswas. 2005. Computer games as intelligent learning environments: A river ecosystem adventure. In AIED. Citeseer, 646--653. Google ScholarDigital Library
- Juan A. Vargas, Lilia García-Mundo, Marcela Genero, and Mario Piattini. 2014. A systematic mapping study on serious game quality. In Proceedings of the International Conference on Evaluation and Assessment in Software Engineering. 15. Google ScholarDigital Library
- Lev Semenovich Vygotsky. 1962. Thought and Language, edited and translated by Eugenia Hanfmann and Gertrude Vakar. New York and London: John Wiley and Sons; Boston: The MIT Press.Google Scholar
- David Watson, Lee A. Clark, and Auke Tellegen. 1998. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology 54, 6 (1998), 1063--1070.Google ScholarCross Ref
- Wim Westera, R. J. Nadolski, Hans G. K. Hummel, and Iwan G. J. H. Wopereis. 2008. Serious games for higher education: A framework for reducing design complexity. J. Comput. Assisted Learn. 24, 5 (2008), 420--432.Google ScholarCross Ref
- Bob G. Witmer and Michael J. Singer. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoper. Virt. Environ. 7, 3 (June 1998), 225--240. Google ScholarDigital Library
- Michael Zyda. 2005. From visual simulation to virtual reality to games. Computer 38, 9 (2005), 25--32. Google ScholarDigital Library
Index Terms
- A Framework to Design, Develop, and Evaluate Immersive and Collaborative Serious Games in Cultural Heritage
Recommendations
A serious game model for cultural heritage
Serious games present a promising opportunity for learning, but the genre still lacks methodologies and tools for efficient and low-cost production, particularly for teacher and domain experts. This article gives an authoring framework that aims to ...
An approach for serious game development for cultural heritage: Case study for an archaeological site and museum
The unique aspects of different places seem to require games of different characteristics. This paper describes the initial steps of an attempt to design games for different places of cultural heritage and consists of three parts. In the first part, the ...
Developing serious games for cultural heritage: a state-of-the-art review
Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The ...
Comments