Abstract
Studies in the literature reported several positive benefits provided by the use of technology in online education, especially in the gamified tutoring system. However, despite the benefits of intelligent tutoring systems, recent studies indicate the presence of a gender gap not considered in the construction of the attributes present in the gamified tutoring system. To investigate this impact by observing users’ behavioral changes in gamified online educational environments, the present study aims to investigate the effects of the stereotype threats using a quantitative experiment with a Factorial Design in three gamified environments (stereotypical male version, stereotypical female version and control environment). Was conducted an experiment with 150 individuals (high school and undergraduate students) without considering age, ethnicity, or social class. The results show that the participants allocated to the male learning environment present an increase in aggressiveness level. Furthermore, the results also show the stereotypical male and female learning environments increased the participants’ performance level. Another finding was that the threatening condition provided a significant increase in the participants’ flow level among males subjected to a threatening condition, which did not manifest in the case of females. In addition, this study also observed the effect of the stereotype threat on men and women in the threatening condition by division in the 34-year age group, resulting in a significant increase in the level of flow among men. This study showed previous results show that the gamified environment influences psychological variables as aggressiveness, intellectual performance, and flow level, they raise questions about the direction of these changes and the impact they may have on users’ usability and performance in these systems.









Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The datasets analysed during the current study are available in the Dataverse repository: https://doi.org/10.7910/DVN/YGL56B.
References
Aguilar, D.A.G., Therón, R., & Peñalvo, F.J.G. (2013). Reveal the relationships among students participation and their outcomes on e-learning environments: case study. In 2013 ieee 13th international conference on advanced learning technologies (pp. 443–447).
Albuquerque, J., Bittencourt, I.I, Coelho, J.A., & Silva, A.P (2017). Does gender stereotype threat in gamified educational environments cause anxiety? an experimental study. Computers & Education, 115, 161–170.
Anderson, C.A., & Bushman, B.J. (2002). Human aggression. Annual Review of Psychology, 53(1), 27–51.
Anderson, J.R, Boyle, CF., & Reiser, B.J (1985). Intelligent tutoring systems. Science, 228(4698), 456–462.
Anya C.H.Y. (2007). Biological components of sex differences in color preference. Current Biology, 17, R623–R625.
Bailey, D.R, & Lee, A.R. (n.d.) Learning from experience in the midst of covid-19: Benefits, challenges, and strategies in online teaching.
Baliscei, J.P. (2020). Abordagem histórica e artística do uso das cores azul e rosa como pedagogias de gênero. Revista Teias, 21, 223–244.
Berger, J.O, Moreno, E., Pericchi, L.R., Bayarri, M.J., Bernardo, J.M., Cano, J.A., De la Horra, J., Martín, J., Ríos-Insúa, D., Betrò, B., & et al (1994). An overview of robust bayesian analysis. Test, 3(1), 5–124.
Bittencourt, I.I., Freires, L., Lu, Y., Challco, G.C., Fernandes, S., Coelho, J., Costa, J., Pian, Y., Marinho, A., & Isotani, S. (2021). Validation and psychometric properties of the brazilian-portuguese dispositional flow scale 2 (dfs-br). PloS one, 16(7), e0253044.
Bittencourt, I.I., Isotani, S., Costa, E., & Mizoguchi, R. (2008). Research directions on semantic web and education. Interdisciplinary Studies in Computer Science, 19(1), 60–67.
Buss, A.H, & Perry, M. (1992). The aggression questionnaire. Journal of Personality and Social Psychology, 63(3), 452.
Cetintas, S., Si, L., Xin, Y.P.P., & Hord, C. (2009). Automatic detection of off-task behaviors in intelligent tutoring systems with machine learning techniques. IEEE Transactions on Learning Technologies, 3(3), 228–236.
Cheung, A.C.K., & Slavin, R.E (2013). The effectiveness of educational technology applications for enhancing mathematics achievement in k-12 classrooms: A meta-analysis. Educational research review, 9, 88–113.
Christy, K.R., & Fox, J. (2014). Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women’s math performance. Computers & Education, 78, 66–77. Retrieved from https://www.sciencedirect.com/science/article/pii/S0360131514001195.
Clarke, S.G, & Haworth, J.T (1994). ‘flow’experience in the daily lives of sixth-form college students. British Journal of Psychology, 85(4), 511–523.
Cohen, P.N (2013). Children’s gender and parents’ color preferences. Archives of sexual behavior, 42(3), 393–397.
Colley, A., & Comber, C. (2003). Age and gender differences in computer use and attitudes among secondary school students: what has changed? Educational Research, 45(2), 155–165.
Cross, L., Kaye, L.K, Savostijanovs, J., McLatchie, N., Johnston, M., Whiteman, L., Mooney, R., & Atherton, G. (2022). Gendered violence and sexualized representations in video games:(lack of) effect on gender-related attitudes. New Media & Society 14614448221075736.
Csikszentmihalyi, M. (2020). Flow (edição revista e atualizada): A psicologia do alto desempenho e da felicidade. Objetiva.
Daouk, Z., Bahous, R., & Bacha, N.N. (2016). Perceptions on the effectiveness of active learning strategies. Journal of Applied Research in Higher Education.
Dasgupta, N., Scircle, M.M., & Hunsinger, M. (2015). Female peers in small work groups enhance women’s motivation, verbal participation, and career aspirations in engineering. Proceedings of the National Academy of Sciences, 112 (16), 4988–4993.
De Sousa Borges, S., Durelli, V.H., Reis, H.M., & Isotani, S. (2014). A systematic mapping on gamification applied to education. In Proceedings of the 29th annual ACM symposium on applied computing (pp. 216–222).
Del Giudice, M. (2012). The twentieth century reversal of pink-blue gender coding: A scientific urban legend?. Archives of Sexual Behavior, 41(6), 1321–1323.
Deterding, S., Sicart, M., Nacke, L., O’Hara, K., & Dixon, D. (2011). Gamification. using game-design elements in non-gaming contexts. In CHI’11 extended abstracts on human factors in computing systems (pp. 2425–2428).
Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Educational Technology & Society, 18, 75–88.
dos Santos, W.O., Bittencourt, I.I., Isotani, S., Dermeval, D., Marques, L.B., & Silveira, Ismar Frango (2018). Flow theory to promote learning in educational systems: Is it really relevant? Revista Brasileira de Informática na Educação, 26(02), 29.
Francescucci, A., Kellershohn, J., & Pyle, M.A. (2020). Using online class preparedness tools to improve student performance: The benefit of “all-in” engagement. Journal of Management Education, 1052562920960205.
Friedman, B., Kahn, P.H., & Borning, A. (2008). Value sensitive design and information systems. The handbook of information and computer ethics, 69–101.
Gómez Contreras, J.L. (2020). Gamificación en contextos educativos: analisis de aplicación en un programa de contaduría pública a distancia. Revista Universidad y Empresa, 22(38), 8–39.
Guerra, P.B.d.C. (2002). Psicologia social dos estereótipos. Psico-USF, 7, 239–240.
Hilton, A., & Armstrong, R.A (2006). Statnote 6: post-hoc anova tests. Microbiologist, 2006, 34–36.
Hwang, G.-J. (2003). A conceptual map model for developing intelligent tutoring systems. Computers & Education, 40(3), 217–235.
Inzlicht, M., & Kang, S.K (2010). Stereotype threat spillover: how coping with threats to social identity affects aggression, eating, decision making, and attention. Journal of personality and social psychology, 99(3), 467.
Inzlicht, M., Tullett, A.M, Legault, L., & Kang, S.K (2011). Lingering effects: Stereotype threat hurts more than you think. Social Issues and Policy Review, 5(1), 227–256.
Jamieson, J.P, & Harkins, S.G (2012). Distinguishing between the effects of stereotype priming and stereotype threat on math performance. Group Processes & Intergroup Relations, 15(3), 291–304.
Jonauskaite, D., Dael, N., Chèvre, L., Althaus, B., Tremea, A., Charalambides, L., & Mohr, C. (2019). Pink for girls, red for boys, and blue for both genders: Colour preferences in children and adults. Sex Roles, 80 (9), 630–642.
Kantharia, M. (2020). Online school education in india during coronavirus pandemic: Benefits and challenges. Research Journal of Humanities and Social Sciences, 11(2), 99–103.
Kappen, D.L, Mirza-Babaei, P., & Nacke, L.E (2019). Older adults’ physical activity and exergames: a systematic review. International Journal of Human–Computer Interaction, 35(2), 140–167.
Kaye, L.K, & Pennington, C.R (2016). “girls can’t play”: The effects of stereotype threat on females’ gaming performance. Computers in Human Behavior, 59, 202–209.
Kaye, L.K., Pennington, C.R., & McCann, J.J. (2018). Do casual gaming environments evoke stereotype threat? examining the effects of explicit priming and avatar gender. Computers in Human Behavior, 78, 142–150.
Kizilcec, R.F., & Lee, H. (2020). Algorithmic fairness in education. arXiv:2007.05443 [cs.CY].
Kizilcec, R.F., Davis, G.M., & Cohen, G.L. (2017). Towards equal opportunities in moocs: affirmation reduces gender & social-class achievement gaps in china. In Proceedings of the fourth (2017) ACM conference on learning@ scale (pp. 121–130).
Kizilcec, R.F., Saltarelli, A.J, Reich, J., & Cohen, G.L (2017). Closing global achievement gaps in moocs. Science, 355(6322), 251–252.
Laureano-Cruces, A.L., Sánchez-Guerrero, L., Velasco-Santos, P., Mora-Torres, M., & Ramírez-Rodríguez, J. (2016). Design of pedagogical agents: the learning styles, the emotions and the color. In E-Learn: world conference on e-learning in corporate, government, healthcare, and higher education (pp. 421–431).
Liu, S., Liu, P., Wang, M., & Zhang, B. (2021). Effectiveness of stereotype threat interventions: A meta-analytic review. Journal of Applied Psychology, 106(6), 921.
Lopes, V., Medina, R., Bernardi, G., & Nunes, F. (2019). Um modelo conceitual para adaptação contínua de elementos de gamificação em ambientes educacionais.
Myers, S.A, & Rocca, K.A (2000). The relationship between perceived instructor communicator style, argumentativeness, and verbal aggressiveness. Communication Research Reports, 17(1), 1–12.
Orji, R., Tondello, G.F, & Nacke, L.E (2018). Personalizing persuasive strategies in gameful systems to gamification user types. In Proceedings of the 2018 CHI conference on human factors in computing systems (pp. 1–14).
Ortner, T., & Sieverding, M. (2008). Where are the gender differences? male priming boosts spatial skills in women. Sex Roles, 59, 274–281.
Pedro, L., & Isotani, S. (2016). Explorando o impacto da gamificação na redução do gaming the system em um ambiente virtual de aprendizagem. Anais dos Workshops do Congresso Brasileiro de Informática na Educação, 5(1), 81. Retrieved from https://brie.org/pub/index.php/wcbie/article/view/6912.
Pennington, C.R., Heim, D., Levy, A.R., & Larkin, D.T. (2016). Twenty years of stereotype threat research: A review of psychological mediators. PLOS One, 11(1), 1–25. https://doi.org/10.1371/journal.pone.0146487.
Riley, J., & Ward, K. (2017). Active learning, cooperative active learning, and passive learning methods in an accounting information systems course. Issues in Accounting Education, 32(2), 1–16.
Rosenberg-Kima, R., Plant, A., Doerr, C., & Baylor, A. (2010). The influence of computer-based model’s race and gender on female students’ attitudes and beliefs towards engineering. Journal of Engineering Education, 99.
Sailer, M., & Homner, L. (2020). The gamification of learning: A meta-analysis. Educational Psychology Review, 32(1), 77–112.
Shapiro, J.R, & Neuberg, S.L (2007). From stereotype threat to stereotype threats: Implications of a multi-threat framework for causes, moderators, mediators, consequences, and interventions. Personality and Social Psychology Review, 11(2), 107–130.
Sheldon, L. (2012). The multiplayer classroom: Designing coursework as a game. Cengage Learning, 16, 1–117.
Snyder, C.R., Lopez, S.J., Snyder, C.R., & Lopez, S.J. (2009). Mindfulness, flow e espiritualidade: em busca das melhores experiências. Psicologia positiva: uma abordagem científica e prática das qualidades humanas. Porto Alegre: Artmed, 222–238.
Steele, C.M (1988). The psychology of self-affirmation: Sustaining the integrity of the self. Advances in Experimental Social Psychology, 21(2), 261–302.
Tabachnick, B.G, Fidell, L.S, & Ullman, J.B. (2007). Using multivariate statistics Vol. 5. Boston: Pearson.
Vakili, H., Niakan, M.H., & Najafi, N. (2019). The effect of classroom red walls on the students’ aggression. International Journal of School Health, 6 (1), 1–4.
Yang, F., & Li, C. (2016). The color of gender stereotyping: The congruity effect of topic, color, and gender on health messages’ persuasiveness in cyberspace. Computers in Human Behavior, 64, 299–307.
Yücel, Y., & Rizvanoglu, K. (2019). Battling gender stereotypes: A user study of a code-learning game, “code combat, ” with middle school children. Compute Human Behavior, 99, 352–365.
Acknowledgements
This study was supported by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) and the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPQ). The authors were also supported by the University of São Paulo (USP), the Federal University of Alagoas (UFAL), the ICMC-USP Software Engineering Laboratory (LABES), and the NEES - Núcleo de Excelência em Tecnologias Sociais.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval
This study received approval from the ethics committee under the number 44824621.1.0000.5013 submitted to the national platform of the Brazilian National Council of Health (referred to as Plataforma Brasil). It is worth noting that data collection and storage have followed strict guidelines of data protection. In addition, all collected data have been anonymized.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Santos, J., Andrade, E., Benevides, K. et al. Does gender stereotype threat affects the levels of aggressiveness, learning and flow in gamified learning environments?: An experimental study. Educ Inf Technol 28, 1637–1662 (2023). https://doi.org/10.1007/s10639-022-11220-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-022-11220-3