Abstract
There are plentiful online programming resources that enable learners to develop an understanding of conceptual knowledge and practical implementation. However, learners, especially novices, often experience difficulties locating the required information to solve the programming problems. Differ from natural language in syntax and convention, answers for programming languages may not be found just by simple text information retrieval. To address this issue, Coding Peekaboom, a game-based tagging was developed to help adequately index the critical concepts of a code segment. An EEG device was applied to measure participants’ mental states to identify their engagement during the gameplay. Study results include the effectiveness of appropriate concepts collected by participants whereas 47.15 concepts were collected on average in a game. The brainwave analysis and the questionnaire results reveal that participants were highly engaged in the tagging task via Coding Peekaboom. Correlations were found between the state of flow and the number of concepts selected, score, and time. Finally, the results of the flow theory and personal traits were reported to reflect the user experiences in the game.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The datasets used during the current study are available from the corresponding author on reasonable request.
References
Ali, F. (2016). Hotel website quality, perceived flow, customer satisfaction and purchase intention. Journal of Hospitality and Tourism Technology, 7(2), 213–228
Allam, H., Bliemel, M., Spiteri, L., Blustein, J., & Ali-Hassan, H. (2019). Applying a multi-dimensional hedonic concept of intrinsic motivation on social tagging tools: A theoretical model and empirical validation. International Journal of Information Management, 45(April 2018), 211–222
Altebarmakian, M., & Alterman, R. (2019). Cohesion in online environments. International Journal of Computer-Supported Collaborative Learning, 14(4), 443–465. https://doi.org/10.1007/s11412-019-09309-y
Bilgihan, A., Nusair, K., Okumus, F., & Cobanoglu, C. (2015). Applying flow theory to booking experiences: An integrated model in an online service context. Information & Management, 52(6), 668–678
Bilgihan, A., Okumus, F., Nusair, K., & Bujisic, M. (2014). Online experiences: Flow theory, measuring online customer experience in e-commerce and managerial implications for the lodging industry. Information Technology & Tourism, 14(1), 49–71
Cha, V. (2020). Asia’s COVID-19 lessons for the west: Public goods, privacy, and social tagging. Washington Quarterly, 43(2), 33–50
Cowley, B., Charles, D., Black, M., & Hickey, R. (2008). Toward an understanding of flow in video games. Computers in Entertainment, 6(2), 20:1–2027
Csikszentmihalyi, M. (2000). Beyond Boredom and Anxiety. Jossey-Bass
de Melo, F. A. C. S. (2017). Flow-Z: A flow-based adaptable game to maintain optimal challenge. Tecnico Lisboa
Desai, R., Tailor, A., & Bhatt, T. (2015a). Complementary Therapies in Clinical Practice Effects of yoga on brain waves and structural activation: A review. Complementary Therapies in Clinical Practice, 21(2), 112–118
Desai, R., Tailor, A., & Bhatt, T. (2015b). Effects of yoga on brain waves and structural activation: A review. Complementary Therapies in Clinical Practice, 21(2), 112–118
Dichev, C., & Dicheva, D. (2017). Gamifying education: what is known, what is believed and what remains uncertain: a critical review. International Journal of Educational Technology in Higher Education, 14(1), 1–36
Dimoka, A., Banker, R. D., Benbasat, I., Davis, F. D., Dennis, A. R., Gefen, D., & Weber, B. (2012). On the use of neurophysiological tools in IS research: Developing a research agenda for neuroIS. MIS Quarterly, 36(3), 679–702
Eickhoff, C., Harris, C. G., de Vries, A. P., & Srinivasan, P. (2012). Quality through flow and immersion: Gamifying crowdsourced relevance assessments. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (pp.871–880)
Fugate, D. L. (2007). Neuromarketing: A layman’s look at neuroscience and its potential application to marketing practice. Journal of Consumer Marketing, 24(7), 385–394
Gaspar, A., Langevin, S., & Boyer, N. (2008). Redundancy and syntax-late approaches in introductory programming courses. Journal of Computing Sciences in Colleges, 24(2), 204–212
Gerbic, P., & Stacey, E. (2005). A purposive approach to content analysis: Designing analytical frameworks. Internet and Higher Education, 8(1), 45–59
Ghani, J. A. (1995). Flow in human computer interactions: Test of a model.Human Factors in Information Systems: Emerging Theoretical Bases,291–311
Harris, D. J., Vine, S. J., & Wilson, M. R. (2017). Is flow really effortless? The complex role of effortful attention. Sport Exercise and Performance Psychology, 6(1), 103–114
Hoffman, D. L., & Novak, T. P. (1996). Marketing in hypermedia computer-mediated environments: Conceptual foundations. Journal of Marketing, 60(3), 50–68
Hsiao, I. H., & Lin, Y. L. (2017). Enriching programming content semantics: An evaluation of visual analytics approach. Computers in Human Behavior, 72, 771–782
Hsiao, I. H. (2015). Explore constructive learning activity in online discussion forums. In The 11th international Conference on Computer Supported Collaborative Learning (pp.223–227). Gothenburg, Sweden
Hsiao, I., & Lin, Y. (2008). Cyber Java Monopoly: Game-based approach of collaborative programming language learning. In Feb 28-March 1, 2008 3rd iConference
Ingulfsen, L., Furberg, A., & Strømme, T. A. (2018). Students’ engagement with real-time graphs in CSCL settings: scrutinizing the role of teacher support. International Journal of Computer-Supported Collaborative Learning, 13(4), 365–390. https://doi.org/10.1007/s11412-018-9290-1
Jacob, E. K. (2004). Classification and Categorization: A Difference that Makes a Difference, 52(3),515–540
Jiang, Z., Chan, J., Tan, B. C. Y., & Chua, W. S. (2010). Effects of interactivity on Website involvement and purchase intention. Journal of the Association for Information Systems, 11(1), 34–59
Kan, D. P. X., & Lee, P. F. (2015). Decrease alpha waves in depression: An electroencephalogram (EEG) study. In 2015 International Conference on BioSignal Analysis, Processing and Systems (ICBAPS) (pp.156–161). IEEE
Kaur, P., Dhir, A., Chen, S., & Rajala, R. (2016). Understanding online regret experience using the theoretical lens of flow experience. Computers in Human Behavior, 57, 230–239
Klašnja-Milićević, A., Vesin, B., & Ivanović, M. (2018). Social tagging strategy for enhancing e-learning experience. Computers and Education, 118(November 2017), 166–181
Koufaris, M. (2002). Applying the technology acceptance model and flow theory to online consumer behavior. Information Systems Research, 13(2), 205–223
Kuan, K. K. Y., Zhong, Y., & Chau, P. Y. K. (2014). Informational and normative social influence in group-buying: Evidence from self-reported and EEG data. Journal of Management Information Systems, 30(4), 151–178
Lee, K. P., Kim, H. G., & Kim, H. J. (2012). A social inverted index for social-tagging-based information retrieval. Journal of Information Science, 38(4), 313–332
Lin, C. C., & Tsai, C. C. (2012). Participatory learning through behavioral and cognitive engagements in an online collective information searching activity. International Journal of Computer-Supported Collaborative Learning, 7(4), 543–566. https://doi.org/10.1007/s11412-012-9160-1
Lin, Y. L., Brusilovsky, P., & He, D. (2016). Finding cultural heritage images through a Dual-Perspective Navigation Framework. Information Processing & Management, 52(5), 820–839
Lin, Y. L., Parra, D., Trattner, C., & Brusilovsky, P. (2019). Tag-based information access in image collections: insights from log and eye-gaze analyses. Knowledge and Information Systems, 61(3), 1715–1742
Linstead, E., Hughes, L., Lopes, C., & Baldi, P. (2009). Exploring Java software vocabulary: A search and mining perspective. In 2009 ICSE Workshop on Search-Driven Development-Users, Infrastructure, Tools and Evaluation (pp. 29–32). IEEE
McMahan, T., Parberry, I., & Parsons, T. D. (2015). Evaluating Player Task Engagement and Arousal Using Electroencephalography. Procedia Manufacturing, 3(Ahfe), 2303–2310. https://doi.org/10.1016/j.promfg.2015.07.376
Morschheuser, B., Hamari, J., Werder, K., & Abe, J. (2017). How to gamify? A method for designing gamification. In Proceedings of the 50th Hawaii International Conference on System Sciences (2017) (pp.1298–1307)
Nacke, L. E., & Lindley, C. A. (2008). Flow and immersion in first-person shooters: Measuring the player’s gameplay experience. Proceedings of the 2008 Conference on Future Play: Research, Play, Share, 81–88
Neurosky Inc (2009). NeuroView User ’ s Guide
Novak, T. P., Hoffman, D. L., & Yung, Y. F. (2000). Measuring the customer experience in online environments: A structural modeling approach. Marketing Science, 19(1), 22–42
Pavlou, P., Davis, F., & Dimoka, A. (2007). Neuro-IS: The potential of cognitive neuroscience for information system research. In Proceedings of the 27th International Conference on Information Systems (ICIS) (p.122). Montreal, Canada
Pelet, J., Ettis, S., & Cowart, K. (2017). Optimal experience of flow enhanced by telepresence: Evidence from social media use. Information & Management, 54(1), 115–128
Peng, H., Hu, B., Liu, Q., Dong, Q., Zhao, Q., & Moore, P. (2011). User-centered depression prevention: An EEG approach to pervasive healthcare. In 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops (pp.325–330). IEEE
Piteira, M., Costa, C. J., & Aparicio, M. (2018). Computer programming learning: How to apply gamification on online courses? Journal of Information Systems Engineering & Management, 3(2), 1–9
Plotnikov, A., Stakheika, N., De Gloria, A., Schatten, C., Bellotti, F., Berta, R., & Ansovini, F. (2012). Exploiting real-time EEG analysis for assessing flow in games. Proceedings of the 12th IEEE International Conference on Advanced Learning Technologies, ICALT 2012, 688–689. https://doi.org/10.1109/ICALT.2012.144
Riedl, R., Banker, R. D., Benbasat, I., Davis, F. D., Dennis, A., Dimoka, A., & Weber, B. (2010). On the foundations of NeuroIS: reflections on the Gmunden Retreat 2009. Communication of the Association for Information Systems, 27(15), 243–264
Rong, W. J., & Min, Y. S. (2005). The effects of learning style and flow experience on the effectiveness of e-learning. In Fifth IEEE International Conference on. Advanced Learning Technologies (ICALT 2005) (pp.802–805)
Shestyuk, A. Y., Kasinathan, K., Karapoondinott, V., Knight, R. T., & Gurumoorthy, R. (2019). Individual EEG measures of attention, memory, and motivation predict population level TV viewership and Twitter engagement. Plos One, 14(3), 1–27
Shum, S. B. (2008). Cohere: Towards web 2.0 argumentation. COMMA, 8, 97–108
Shum, S. B., & Ferguson, R. (2012). Social learning analytics. Journal of Educational Technology & Society, 15(3), 3–26
Skadberg, Y. X., & Kimmel, J. R. (2004). Visitors’ flow experience while browsing a web site: its measurement, contributing factors and consequences. Computers in Human Behavior, 20(3), 403–422
Steuer, J. (1992). Defining virtual reality: Dimensions determining telepresence. Journal of Communication, 42(4), 73–93
Tiago-Costa, E., Quelhas-Costa, E., & Santos-Baptista, J. (2016). Changes in EEG amplitude (Alpha and Beta waves) with Thermal environment. Dyna, 83(197), 87–93
Toth, A., & Tovolgyi, S. (2017). The introduction of gamification: A review paper about the applied gamification in the smartphone applications. In 7th IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2016 - Proceedings (pp.213–217)
Trant, J. (2009). Studying social tagging and folksonomy: A review and framework. Journal of Digital Information, 10(1), 1–44
Ülker, B., Tabakcioǧlu, M. B., Çizmeci, H., & Ayberkin, D. (2017). Relations of attention and meditation level with learning in engineering education. In Proceedings of the 9th International Conference on Electronics, Computers and Artificial Intelligence, ECAI 2017 (pp.1–4)
von Ahn, L., & Dabbish, L. (2004). Labeling images with a computer game. In Proceedings of the 2004 conference on Human factors in computing systems - CHI ’04 (pp.319–326)
von Ahn, L., Ruoran, L., & Manuel, B. (2006). Peekaboom: A game for locating objects in images. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’06 (pp.55–64)
Wal, T., & Vander (2005). Folksonomy coinage and definition. Retrieved August 22, 2012, from http://vanderwal.net/folksonomy.html
Wang, C. C., & Hsu, M. C. (2014). An exploratory study using inexpensive electroencephalography (EEG) to understand flow experience in computer-based instruction. Information & Management, 51, 912–923
Wilson, C., Sudol, L. A., Stephenson, C., & Stehlik, M. (2010). Running on empty: The failure to teach K-12 computer science in the digital age. ACM
Yager, S. E., Kappelman, L. A., Maples, G. A., & Prybutok, V. R. (1997). Microcomputer playfulness: Stable or dynamic trait? ACM SIGMIS Database: The DATABASE for Advances in Information Systems, 28(2), 43–52
Yang, X., Cheng, P. Y., Lin, L., Huang, Y. M., & Ren, Y. (2019). Can an Integrated System of Electroencephalography and Virtual Reality Further the Understanding of Relationships Between Attention, Meditation, Flow State, and Creativity? Journal of Educational Computing Research, 57(4), 846–876
Funding
This research was supported in part by MOST 110-2410-H-004-026-MY3 to the first author, and MOST 109-2410-H-004-067-MY2 to the second author.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Lin, YL., Chien, SY., Su, WC. et al. Coding peekaboom: a gaming mechanism for harvesting programming concepts. Educ Inf Technol 28, 3765–3785 (2023). https://doi.org/10.1007/s10639-022-11337-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-022-11337-5