Abstract
When entering higher education, students must become more autonomous in their learning, particularly know how to take stock of their ways of learning: identify what they know, and also what they do not know, then adapt their learning strategies. They must therefore develop metacognitive skills. This article analyzes the responses of 3830 newly arrived undergraduate students through a pre-requisites test including confidence levels. Focus is given on both their success rate, i.e., their achievement at the test, and their realism, i.e., if they were predictive in their confidence judgement. To compute a relevant realism index, previous work by Prosperi [1] is extended to our context. First, an expected course effect is observed: one of the seven proposed courses reveals a lower realism index, and at the same time, its success rate is lower too. Moreover, a gender impact is highlighted: females reach a higher realism index than males and this gap fluctuates over the 4 last years. This gender effect is probably different from the course effect because success rates of males and females remain equivalent, thus success rate and realism seem to be dissociated in this case. Finally, students who perform poorly on the pre-requisites test and choose to take a second session after a remediation period improve their results: both gaps of success rate and realism are closed. That could prove the relevance of the remediation, and/or the effect of metacognition feed-back provided just at the end of the pre-requisites test.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Prosperi, O.: Le réalisme avec degrés de certitude. Mes. Éval. En Éduc. 38, 121–140 (2015). https://doi.org/10.7202/1036553ar
Noël, B., Leclercq, D.: Comment développer des capacités cognitives et métacognitives ? In: Recherches et actions en faveur de la réussite en première année universitaire. Vingt ans de collaboration dans la Commission « Réussite » du Conseil interuniversitaire de la Communauté française de Belgique. CIUF, Bruxelles (2011)
Schraw, G., Moshman, D.: Metacognitive theories. Educ. Psychol. Rev. 7, 351–371 (1995). https://doi.org/10.1007/BF02212307
Biasutti, M., Frate, S.: Group metacognition in online collaborative learning: validity and reliability of the group metacognition scale (GMS). Educ. Technol. Res. Dev. 66(6), 1321–1338 (2018). https://doi.org/10.1007/s11423-018-9583-0
Gardner-Medwin, A.R., Gahan, M.: Formative and summative confidence-based assessment. In: 7th International Computer-Aided Assessment Conference, pp. 147–155. Loughborough University, UK (2003)
Butler, A.C., Karpicke, J.D., Roediger, H.L.: Correcting a metacognitive error: feedback increases retention of low-confidence correct responses. J. Exp. Psychol. Learn. Mem. Cogn. 34, 918–928 (2008). https://doi.org/10.1037/0278-7393.34.4.918
Gilles, J.-L.: Entraînement à l’autoévaluation: une comparaison filles/garçons à l’université. In: Actes du colloque de l’AIPU. Enseignement supérieur: stratégies d’enseignement appropriées, Hull, pp. 159–166. Université du Québec (1995)
Curtis, D.A., Lind, S.L., Boscardin, C.K., Dellinges, M.: Does student confidence on multiple-choice question assessments provide useful information? Med. Educ. 47, 578–584 (2013). https://doi.org/10.1111/medu.12147
Hassmen, P., Hunt, D.P.: Human self-assessment in multiple-choice testing. J. Educ. Meas. 31, 149–160 (1994). https://doi.org/10.1111/j.1745-3984.1994.tb00440.x
Al-Shanfari, L., Demmans Epp, C., Baber, C., Nazir, M.: Visualising alignment to support students’ judgment of confidence in open learner models. User Model. User-Adapt. Interact. 30(1), 159–194 (2020). https://doi.org/10.1007/s11257-019-09253-4
Andriamiseza, R., Silvestre, F., Parmentier, J.-F., Broisin, J.: Recommendations for orchestration of formative assessment sequences: a data-driven approach. In: De Laet, T., Klemke, R., Alario-Hoyos, C., Hilliger, I., Ortega-Arranz, A. (eds.) Technology-Enhanced Learning for a Free, Safe, and Sustainable World, vol. 12884, pp. 245–259. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-86436-1_19
Leclercq, D.: J’en suis aussi sûr que vous, mais pas avec le même pourcentage de chances, que ce soit hors contexte ou en contexte Deux études sur la variabilité inter-individus des significations métriques données aux degrés de certitude verbaux. Evaluer J. Int. Rech. En Educ. Form. 2, 89–125 (2016)
Leclercq, D.: Une mata-analyse des degrés de certitude exprimés en mots. Evaluer J. Int. Rech. En Educ. Form. 2, 69–105 (2017)
Gilles, J.-L.: Qualité spectrale des tests standardisés universitaires - Mise au point d’indices édumétriques d’analyse de la qualité spectrale des évaluations des acquis des étudiants universitaires et application aux épreuves MOHICAN check up ’99 [Ph. D., Liège] (2002). https://hdl.handle.net/2268/2217
Brown, T.A., Shuford, E.H.: Quantifying uncertainty into numerical probabilities for the reporting of intelligence (1973). https://apps.dtic.mil/sti/pdfs/AD0777063.pdf
Leclercq, D.: Diagnostic cognitif et métacognitif au seuil de l’université: le projet Mohican mené par les 9 universités de la communauté française Wallonie Bruxelles. ULg, Liège (2003)
Newcombe, R.G.: Interval estimation for the difference between independent proportions: comparison of eleven methods. Stat. Med. 17, 873–890 (1998). https://doi.org/10.1002/(SICI)1097-0258(19980430)17:8%3c873::AID-SIM779%3e3.0.CO;2-I
Khan, K.S., Davies, D.A., Gupta, J.K.: Formative self-assessment using multiple true-false questions on the internet: feedback according to confidence about correct knowledge. Med. Teach. 23, 158–163 (2001). https://doi.org/10.1080/01421590031075
Koivula, N., Hassmén, P., Hunt, D.P.: Performance on the Swedish scholastic aptitude test: effects of self-assessment and gender. Sex Roles 44, 629–645 (2001). https://doi.org/10.1023/A:1012203412708
Hoffmann, C., Douady, J., Buty, C.: Test initial de prérequis : quelles corrélations avec la réussite en première année universitaire? In: Actualité de la Recherche en Éducation et Formation (AREF), Montpellier, France (2013)
Howell, D.C.: Statistical Methods for Psychology. Cengage Learning (2012)
Tomczak, M., Tomczak, E.: The need to report effect size estimates revisited: an overview of some recommended measures of effect size. TRENDS Sport Sci. 1, 19–25 (2014)
Kruger, J., Dunning, D.: Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J. Pers. Soc. Psychol. 77, 1121–1134 (1999)
Gignac, G.E., Zajenkowski, M.: The Dunning-Kruger effect is (mostly) a statistical artefact: valid approaches to testing the hypothesis with individual differences data. Intelligence 80, 101449 (2020). https://doi.org/10.1016/j.intell.2020.101449
Krueger, J., Mueller, R.A.: Unskilled, unaware, or both? The better-than-average heuristic and statistical regression predict errors in estimates of own performance. J. Pers. Soc. Psychol. 82, 180–188 (2002). https://doi.org/10.1037/0022-3514.82.2.180
Acknowledgements
This work is funded by CNRS and LIG. Authors want to thank Hubert Borderiou, who develops specific routines on the local LMS platform, and Astor Bizard and Nadia Brauner-Vettier, who develop specific plug-in for Caseine (a Moodle-like LMS).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Douady, J., Hoffmann, C., Mandran, N. (2022). Effects of Course, Gender, and Remediation on both Success Rate and Realism of Undergraduates on Pre-requisites Testing. In: Hilliger, I., Muñoz-Merino, P.J., De Laet, T., Ortega-Arranz, A., Farrell, T. (eds) Educating for a New Future: Making Sense of Technology-Enhanced Learning Adoption. EC-TEL 2022. Lecture Notes in Computer Science, vol 13450. Springer, Cham. https://doi.org/10.1007/978-3-031-16290-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-16290-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16289-3
Online ISBN: 978-3-031-16290-9
eBook Packages: Computer ScienceComputer Science (R0)