Abstract
This paper presents the results of a study whose main objective was to analyze the assessments by exam in higher education according to the SOLO Taxonomy (Structure of the Observed Learning Outcome) over the last five years, in particular the cognitive complexity required in each question and the “quality” of the exam. The data were collected in the Mathematical Analysis exams of the Degree in Electrical and Computer Engineering. In total, 130 items presented in 10 exams (2 per year) from 2019 to 2023 were surveyed. The SOLO index of these exams was always higher than 16, with the exception of one exam from 2023 with an index of 14.55. The analysis reveals that the exams are composed of items classified at the highest levels of cognitive complexity, according to the SOLO Taxonomy, and associated with the student’s deep learning. Thus the authors were able to study their pedagogical practices in relation to the assessment and, consequently, to consciously prepare the assessment.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brown, S., Knight, P.: Assessing Learners in Higher Education. Psychology Press (1994). ISBN: 9780749411138
Brown, S., Race, P., Rust, C.: Using and experiencing assessment. In: Assessment for Learning in Higher Education, pp. 75–85. Routledge (2012). ISBN: 9780203062074
Van de Watering, G., Gijbels, D., Dochy, F., Van der Rijt, J.: Students’ assessment preferences, perceptions of assessment and their relationships to study results. Higher Educ. 56, 645–658 (2008). https://doi.org/10.1007/s10734-008-9116-6
Biggs, J.B., Collis, K.F.: Evaluating the Quality of Learning: The Solo Taxonomy New York. Academic Press (1982). https://doi.org/10.1016/C2013-0-10375-3
de Almeida Santos Pereira, V.C.: Aplicação da taxonomia solo nos exames nacionais de matemática do 12\({ }^{ \underline {\mathrm {o}}}\) ano. Seven Editora (2023). http://sevenpublicacoes.com.br/index.php/editora/article/view/396
Pegg, J., Tall, D.: The fundamental cycle of concept construction underlying various theoretical frameworks. In: Sriraman, B., English, L. (eds.) Theories of Mathematics Education: Seeking New Frontiers, pp. 173–192. Springer, New York (2010). https://doi.org/10.1007/BF02655855
Pereira, V.C.A.S.: Aplicação da Taxonomia Solo na Análise da Qualidade da Avaliação. Validação do Método Analítico por Aplicação aos Exames Nacionais de Matemática A entre 2006 e 2014, vol. I, UBI, Covilhã (2019). http://hdl.handle.net/10400.6/7091
Filipe, M.A.E.R.: A Taxonomia SOLO nos Exames Nacionais de Matemática – 9\({ }^{ \underline {\mathrm {o}}}\) Ano. Universidade Nova de Lisboa. Lisboa - Portugal, p. 189 (2011). http://hdl.handle.net/10362/8173
Malik, S.I., Tawafak, R.M., Shakir, M.: Aligning and assessing teaching approaches with solo taxonomy in a computer programming course. Int. J. Inf. Commun. Technol. Educ. 17(4), 1–15 (2021). https://doi.org/10.4018/IJICTE.20211001.oa
Mol, S.M., Matos, D.A.S.: Uma análise sobre a taxonomia solo: aplicações na avaliação educacional. Estudos Em Avaliação Educacional 30(75), 722–747 (2019). https://doi.org/10.18222/eae.v30i75.6593
Malasari, P.N., Sari, A., Haqiqi, A.K., Masrukhin, M., Qomariyah, S: Using the SOLO taxonomy to investigate students’ mathematical creative thinking proficiency. In: AIP Conference Proceedings, vol. 2595, No. 1. AIP Publishing (2023). https://doi.org/10.1063/5.0123686
Liu, S., Zhang, C.: Research on mathematics test questions of high school entrance examination based on the SOLO taxonomy theory: take the 2019–2021 Jinan High School entrance examination questions as an example, 2022. In: 12th International Conference on Information Technology in Medicine and Education (ITME), Xiamen, 2022, pp. 151–155. https://doi.org/10.1109/ITME56794.2022.00041
Aydin, U., Birgili, B.: Assessing Mathematical Higher-Order Thinking Skills: An Analysis of Turkish University Entrance Examinations. Educational Assessment, pp. 1–20 (2023). https://doi.org/10.1080/10627197.2023.2202311
Ceia, M.: A taxonomia SOLO e os níveis de van Hiele (2002). https://www.researchgate.net/publication/237709095
Castro, F.E.V., Fisler, K.: Designing a multi-faceted SOLO taxonomy to track program design skills through an entire course. In: Proceedings of the 17th Koli Calling International Conference on Computing Education Research, pp. 10–19 (2017). https://doi.org/10.1145/3141880.3141891
Caridade, C.M.R., Pereira, V.: SOLO taxonomy to assessment of skills and competencies required to students: comparison between online versus face-to-face exam. In: Mesquita, A., Abreu, A., Carvalho, J.V., Santana, C., de Mello, C.H.P. (eds.) Perspectives and Trends in Education and Technology. ICITED 2023. Smart Innovation, Systems and Technologies, vol. 366. Springer, Singapore (2023). https://doi.org/10.1007/978-981-99-5414-8_52
Silwana, A., Subanji, S., Manyunu, M., Rashahan, A.A.: Students’ responses leveling in solving mathematical problem based on SOLO taxonomy viewed from multiple intelligences. Indones. J. Learn. Adv. Educ. 3(1), 1–16 (2021). https://doi.org/10.23917/ijolae.v3i1.10528
Alpers, B.A., Demlova, M., Fant, C.H., Gustafsson, T., Lawson, D., Mustoe, L., Velichova, D.: A framework for mathematics curricula in engineering education: a report of the mathematics working group (2013). ISBN: 978-2-87352-007-6
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Caridade, C.R., Pereira, V. (2024). SOLO Taxonomy in the Evaluation of Engineering Students: A Case Study in Mathematics. In: Gayoso Martínez, V., Yilmaz, F., Queiruga-Dios, A., Rasteiro, D.M., Martín-Vaquero, J., Mierluş-Mazilu, I. (eds) Mathematical Methods for Engineering Applications. ICMASE 2023. Springer Proceedings in Mathematics & Statistics, vol 439. Springer, Cham. https://doi.org/10.1007/978-3-031-49218-1_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-49218-1_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-49217-4
Online ISBN: 978-3-031-49218-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)