Skip to main content

SOLO Taxonomy in the Evaluation of Engineering Students: A Case Study in Mathematics

  • Conference paper
  • First Online:
Mathematical Methods for Engineering Applications (ICMASE 2023)

Abstract

This paper presents the results of a study whose main objective was to analyze the assessments by exam in higher education according to the SOLO Taxonomy (Structure of the Observed Learning Outcome) over the last five years, in particular the cognitive complexity required in each question and the “quality” of the exam. The data were collected in the Mathematical Analysis exams of the Degree in Electrical and Computer Engineering. In total, 130 items presented in 10 exams (2 per year) from 2019 to 2023 were surveyed. The SOLO index of these exams was always higher than 16, with the exception of one exam from 2023 with an index of 14.55. The analysis reveals that the exams are composed of items classified at the highest levels of cognitive complexity, according to the SOLO Taxonomy, and associated with the student’s deep learning. Thus the authors were able to study their pedagogical practices in relation to the assessment and, consequently, to consciously prepare the assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brown, S., Knight, P.: Assessing Learners in Higher Education. Psychology Press (1994). ISBN: 9780749411138

    Google Scholar 

  2. Brown, S., Race, P., Rust, C.: Using and experiencing assessment. In: Assessment for Learning in Higher Education, pp. 75–85. Routledge (2012). ISBN: 9780203062074

    Google Scholar 

  3. Van de Watering, G., Gijbels, D., Dochy, F., Van der Rijt, J.: Students’ assessment preferences, perceptions of assessment and their relationships to study results. Higher Educ. 56, 645–658 (2008). https://doi.org/10.1007/s10734-008-9116-6

    Article  Google Scholar 

  4. Biggs, J.B., Collis, K.F.: Evaluating the Quality of Learning: The Solo Taxonomy New York. Academic Press (1982). https://doi.org/10.1016/C2013-0-10375-3

  5. de Almeida Santos Pereira, V.C.: Aplicação da taxonomia solo nos exames nacionais de matemática do 12\({ }^{ \underline {\mathrm {o}}}\) ano. Seven Editora (2023). http://sevenpublicacoes.com.br/index.php/editora/article/view/396

  6. Pegg, J., Tall, D.: The fundamental cycle of concept construction underlying various theoretical frameworks. In: Sriraman, B., English, L. (eds.) Theories of Mathematics Education: Seeking New Frontiers, pp. 173–192. Springer, New York (2010). https://doi.org/10.1007/BF02655855

    Chapter  Google Scholar 

  7. Pereira, V.C.A.S.: Aplicação da Taxonomia Solo na Análise da Qualidade da Avaliação. Validação do Método Analítico por Aplicação aos Exames Nacionais de Matemática A entre 2006 e 2014, vol. I, UBI, Covilhã (2019). http://hdl.handle.net/10400.6/7091

  8. Filipe, M.A.E.R.: A Taxonomia SOLO nos Exames Nacionais de Matemática – 9\({ }^{ \underline {\mathrm {o}}}\) Ano. Universidade Nova de Lisboa. Lisboa - Portugal, p. 189 (2011). http://hdl.handle.net/10362/8173

  9. Malik, S.I., Tawafak, R.M., Shakir, M.: Aligning and assessing teaching approaches with solo taxonomy in a computer programming course. Int. J. Inf. Commun. Technol. Educ. 17(4), 1–15 (2021). https://doi.org/10.4018/IJICTE.20211001.oa

    Article  Google Scholar 

  10. Mol, S.M., Matos, D.A.S.: Uma análise sobre a taxonomia solo: aplicações na avaliação educacional. Estudos Em Avaliação Educacional 30(75), 722–747 (2019). https://doi.org/10.18222/eae.v30i75.6593

    Article  Google Scholar 

  11. Malasari, P.N., Sari, A., Haqiqi, A.K., Masrukhin, M., Qomariyah, S: Using the SOLO taxonomy to investigate students’ mathematical creative thinking proficiency. In: AIP Conference Proceedings, vol. 2595, No. 1. AIP Publishing (2023). https://doi.org/10.1063/5.0123686

  12. Liu, S., Zhang, C.: Research on mathematics test questions of high school entrance examination based on the SOLO taxonomy theory: take the 2019–2021 Jinan High School entrance examination questions as an example, 2022. In: 12th International Conference on Information Technology in Medicine and Education (ITME), Xiamen, 2022, pp. 151–155. https://doi.org/10.1109/ITME56794.2022.00041

  13. Aydin, U., Birgili, B.: Assessing Mathematical Higher-Order Thinking Skills: An Analysis of Turkish University Entrance Examinations. Educational Assessment, pp. 1–20 (2023). https://doi.org/10.1080/10627197.2023.2202311

  14. Ceia, M.: A taxonomia SOLO e os níveis de van Hiele (2002). https://www.researchgate.net/publication/237709095

  15. Castro, F.E.V., Fisler, K.: Designing a multi-faceted SOLO taxonomy to track program design skills through an entire course. In: Proceedings of the 17th Koli Calling International Conference on Computing Education Research, pp. 10–19 (2017). https://doi.org/10.1145/3141880.3141891

  16. Caridade, C.M.R., Pereira, V.: SOLO taxonomy to assessment of skills and competencies required to students: comparison between online versus face-to-face exam. In: Mesquita, A., Abreu, A., Carvalho, J.V., Santana, C., de Mello, C.H.P. (eds.) Perspectives and Trends in Education and Technology. ICITED 2023. Smart Innovation, Systems and Technologies, vol. 366. Springer, Singapore (2023). https://doi.org/10.1007/978-981-99-5414-8_52

    Google Scholar 

  17. Silwana, A., Subanji, S., Manyunu, M., Rashahan, A.A.: Students’ responses leveling in solving mathematical problem based on SOLO taxonomy viewed from multiple intelligences. Indones. J. Learn. Adv. Educ. 3(1), 1–16 (2021). https://doi.org/10.23917/ijolae.v3i1.10528

    Google Scholar 

  18. Alpers, B.A., Demlova, M., Fant, C.H., Gustafsson, T., Lawson, D., Mustoe, L., Velichova, D.: A framework for mathematics curricula in engineering education: a report of the mathematics working group (2013). ISBN: 978-2-87352-007-6

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cristina M. R. Caridade .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Caridade, C.R., Pereira, V. (2024). SOLO Taxonomy in the Evaluation of Engineering Students: A Case Study in Mathematics. In: Gayoso Martínez, V., Yilmaz, F., Queiruga-Dios, A., Rasteiro, D.M., Martín-Vaquero, J., Mierluş-Mazilu, I. (eds) Mathematical Methods for Engineering Applications. ICMASE 2023. Springer Proceedings in Mathematics & Statistics, vol 439. Springer, Cham. https://doi.org/10.1007/978-3-031-49218-1_8

Download citation

Publish with us

Policies and ethics