short-paper

SGSEAM: assessing serious game frameworks from a stakeholder experience perspective

Authors:

Jordan TakayamaAuthors Info & Claims

Gamification '13: Proceedings of the First International Conference on Gameful Design, Research, and Applications

Pages 75 - 78

https://doi.org/10.1145/2583008.2583018

Published: 02 October 2013 Publication History

Get Access

Abstract

Assessment of serious game frameworks is emerging as an important area of research. This paper describes an assessment mechanism called the Serious Game Stakeholder Experience Assessment Method (SGSEAM). SGSEAM is designed to provide detailed insights into the strengths and shortcomings of serious game frameworks through a stakeholder perspective based approach. In this paper, we report on the use of SGSEAM to assess Makahiki, an open source serious game framework for sustainability. Our results provide useful insights into both Makahiki as a serious game framework and SGSEAM as an assessment method.

References

[1]

Brockmyer, J. H., Fox, C. M., Curtiss, K. A., McBroom, E., Burkhart, K. M., and Pidruzny, J. N. The development of the game engagement questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4 (2009), 624--634.

Crossref

Google Scholar

[2]

Caldiera, V. R. B. G., and Rombach, H. D. The goal question metric approach. Encyclopedia of software engineering 2 (1994), 528--532.

Google Scholar

[3]

Creswell, J. W. Research design: qualitative, quantitative, and mixed methods approaches, 2nd ed. ed. Sage Publications, Thousand Oaks, California, 2003.

Google Scholar

[4]

Deterding, S., Dixon, D., Khaled, R., and Nacke, L. From game design elements to gamefulness: Defining "gamification". In Proceedings of MindTrek (2011).

Digital Library

Google Scholar

[5]

Harper, B. D., and Norman, K. L. Improving user satisfaction: The questionnaire for user interaction satisfaction version 5.5. In Proceedings of the 1st Annual Mid-Atlantic Human Factors Conference (1993), 224--228.

Google Scholar

[6]

Harteveld, C. Triadic game evaluation: A framework for assessing games with a serious purpose. In Workshop of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (2010).

Google Scholar

[7]

Hurteau, M., Houle, S., and Mongiat, S. How legitimate and justified are judgments in program evaluation? Evaluation 15, 3 (2009), 307--319.

Crossref

Google Scholar

[8]

Johnson, P. M., Xu, Y., Brewer, R. S., Moore, C. A., Lee, G. E., and Connell, A. Makahiki+WattDepot: An open source software stack for next generation energy research and education. In Proceedings of the 2013 Conference on Information and Communication Technologies for Sustainability (ICT4S) (February 2013).

Google Scholar

[9]

Mayer, I. Towards a comprehensive methodology for the research and evaluation of serious games. Procedia Computer Science 15, 0 (2012), 233--247.

Crossref

Google Scholar

[10]

Xu, Y. Approach to access system admin and game designer experiences in makahiki. Tech. Rep. CSDL-13-04, Department of Information and Computer Sciences, University of Hawaii, Honolulu, Hawaii 96822, June 2013.

Google Scholar

[11]

Zyda, M. From visual simulation to virtual reality to games. IEEE Computer 38, 9 (Sep 2005), 25--32.

Digital Library

Google Scholar

Cited By

View all

Ghiga IRichardson SÁlvarez AKato MNaidoo DOtsu SNguyen PNguyen PNguyen T(2021)PIPDeploy: Development and implementation of a gamified table top simulation exercise to strengthen national pandemic vaccine preparedness and readinessVaccine10.1016/j.vaccine.2020.11.04739:2(364-371)Online publication date: Jan-2021
https://doi.org/10.1016/j.vaccine.2020.11.047
Dunwell ILameras P(2020)The Design and Development of a Game-Based Approach to Entrepreneurship EducationInternet of Things, Infrastructures and Mobile Applications10.1007/978-3-030-49932-7_56(594-605)Online publication date: 10-Sep-2020
https://doi.org/10.1007/978-3-030-49932-7_56
Abdellatif AMcCollum BMcMullan P(2018)Serious games: Quality characteristics evaluation framework and case study2018 IEEE Integrated STEM Education Conference (ISEC)10.1109/ISECon.2018.8340460(112-119)Online publication date: Mar-2018
https://doi.org/10.1109/ISECon.2018.8340460
Show More Cited By

Index Terms

SGSEAM: assessing serious game frameworks from a stakeholder experience perspective

Recommendations

Purposeful by design?: a serious game design assessment framework
FDG '12: Proceedings of the International Conference on the Foundations of Digital Games

The lack of assessment tools to analyze serious games and insufficient knowledge on their impact on players is a recurring critique in the field of game and media studies, education science and psychology. Although initial empirical studies on serious ...
Dive Deeper: Empirical Analysis of Game Mechanics and Perceived Value in Serious Games
CHI PLAY

Validation of serious games tends to focus on evaluating their design as a whole. While this helps to assess whether a particular combination of game mechanics is successful, it provides little insight into how individual mechanics contribute or detract ...
Last Island: Exploring Transitions to Sustainable Futures through Play
ACSW '19: Proceedings of the Australasian Computer Science Week Multiconference

A serious game was designed and developed with the goal of exploring potential sustainable futures and the transitions towards them. This computer-assisted board game, Last Island, which incorporates a system dynamics model into a board game's core ...

Comments

Information & Contributors

Information

Published In

Gamification '13: Proceedings of the First International Conference on Gameful Design, Research, and Applications

October 2013

148 pages

ISBN:9781450328159

DOI:10.1145/2583008

General Chairs:
Lennart E. Nacke
University of Ontario Institute of Technology, Canada
,
Kevin Harrigan
University of Waterloo, Canada
,
Neil Randall
University of Waterloo, Canada

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Division of Information and Intelligent Systems

Conference

Gamification '13

Sponsor:

UWATERLOO
IMMERSe
Waterloo Stratford Campus

Gamification '13: Gameful Design, Research, and Applications

October 2 - 4, 2013

Ontario, Toronto, Canada

Acceptance Rates

Gamification '13 Paper Acceptance Rate 9 of 25 submissions, 36%;

Overall Acceptance Rate 9 of 25 submissions, 36%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
300
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ghiga IRichardson SÁlvarez AKato MNaidoo DOtsu SNguyen PNguyen PNguyen T(2021)PIPDeploy: Development and implementation of a gamified table top simulation exercise to strengthen national pandemic vaccine preparedness and readinessVaccine10.1016/j.vaccine.2020.11.04739:2(364-371)Online publication date: Jan-2021
https://doi.org/10.1016/j.vaccine.2020.11.047
Dunwell ILameras P(2020)The Design and Development of a Game-Based Approach to Entrepreneurship EducationInternet of Things, Infrastructures and Mobile Applications10.1007/978-3-030-49932-7_56(594-605)Online publication date: 10-Sep-2020
https://doi.org/10.1007/978-3-030-49932-7_56
Abdellatif AMcCollum BMcMullan P(2018)Serious games: Quality characteristics evaluation framework and case study2018 IEEE Integrated STEM Education Conference (ISEC)10.1109/ISECon.2018.8340460(112-119)Online publication date: Mar-2018
https://doi.org/10.1109/ISECon.2018.8340460
Garca FPedreira OPiattini MCerdeira-Pena APenabad M(2017)A framework for gamification in software engineeringJournal of Systems and Software10.1016/j.jss.2017.06.021132:C(21-40)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1016/j.jss.2017.06.021
Sailer MHense JMayr SMandl H(2017)How gamification motivatesComputers in Human Behavior10.1016/j.chb.2016.12.03369:C(371-380)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1016/j.chb.2016.12.033
Xu YJohnson PLee GMoore CBrewer R(2017)Design and Evaluation of the Makahiki Open Source Serious Game Framework for Sustainability EducationSustainability, Green IT and Education Strategies in the Twenty-first Century10.1007/978-3-319-57070-9_18(503-523)Online publication date: 27-Jul-2017
https://doi.org/10.1007/978-3-319-57070-9_18

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Purposeful by design?: a serious game design assessment framework

Dive Deeper: Empirical Analysis of Game Mechanics and Perceived Value in Serious Games

Last Island: Exploring Transitions to Sustainable Futures through Play

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations