Skip to main content

Participants’ Perception of Tasks in an Informatics Contest

  • Conference paper
  • First Online:
Informatics in Schools. Engaging Learners in Computational Thinking (ISSEP 2020)

Abstract

Bebras is a contest organized for schools to promote computational thinking and new tasks are developed for it every year. The contest is held online in over 50 countries around the world and its results provide a great deal of information regarding difficulty levels of particular tasks and factors influencing participants’ success in the contest. Our paper brings an analysis of such hard data in relation to statements of those participants who expressed their opinion on the difficulty of particular tasks and whose statements could be matched with their actual academic performance in the contest. Questionnaires were voluntarily completed by contestants participating in the Senior category (for the oldest participants aged over 16) from the Czech Republic.

Statistical analysis of contest results and perceived task difficulty provided new findings. There is no relationship between the proportion of participants with wrong answers to tasks and participants’ subjective perception of task difficulty. Subjective difficulty is more aptly expressed in terms of the proportion of participants who did not answer the task. The contest was perceived as being easier by those participants who achieved higher scores in it. Male participants demonstrate a higher level of self-esteem in terms of IT skills than female participants. However, female participants’ self-perceptions of their IT skills are slightly more accurate than males’. Results presented in the article could help the authors of the contest to improve compilation of contest tasks and have them included in the Informatics curriculum.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bebras website. http://bebras.org. Accessed 21 May 2020

  2. Dagienė, V.: Information technology contests – introduction to computer science in an attractive way. Inf. Educ. 5(1), 37–46 (2006)

    Google Scholar 

  3. Wing, J.M.: Research notebook: computational thinking: what and why? In: The Link. Carneige Mellon, Pittsburgh (2010)

    Google Scholar 

  4. Selby, C., Woollard, J.: Computational thinking: the developing definition. In: Special Interest Group on Computer Science Education (SIGCSE) 2014. ACM, Atlanta (2014)

    Google Scholar 

  5. ISTE, CSTA: Operational Definition of Computational Thinking for K-12 Education (2011). https://id.iste.org/docs/ct-documents/computational-thinking-operational-definition-flyer.pdf

  6. Dagienė, V., Sentance, S.: It’s computational thinking! Bebras tasks in the curriculum. In: Brodnik, A., Tort, F. (eds.) ISSEP 2016. LNCS, vol. 9973, pp. 28–39. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46747-4_3

    Chapter  Google Scholar 

  7. van der Vegt, W.: Predicting the difficulty level of a Bebras task. Olympiads Inform. 7, 132–139 (2013)

    Google Scholar 

  8. van der Vegt, W.: How hard will this task be? Developments in analyzing and predicting question difficulty in the Bebras challenge. Olympiads Inform. 12, 119–132 (2018). https://doi.org/10.15388/ioi.2018.10

    Article  Google Scholar 

  9. Pohl, W., Hein, H.-W.: Aspects of quality in the presentation of informatics challenge tasks. In: Jekovec, M. (ed.) The Proceedings of International Conference on Informatics in Schools: Situation, Evolution and Perspectives, ISSEP 2015, pp. 21–32. University of Ljubljana, Ljubljana (2015)

    Google Scholar 

  10. Dagienė, V., Futschek, G.: Bebras international contest on informatics and computer literacy: criteria for good tasks. In: Mittermeir, R.T., Sysło, M.M. (eds.) ISSEP 2008. LNCS, vol. 5090, pp. 19–30. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69924-8_2

    Chapter  Google Scholar 

  11. Vaníček, J.: Bebras informatics contest: criteria for good tasks revised. In: Gülbahar, Y., Karataş, E. (eds.) ISSEP 2014. LNCS, vol. 8730, pp. 17–28. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-09958-3_3

    Chapter  Google Scholar 

  12. Vaníček, J.: What makes situational informatics tasks difficult? In: Brodnik, A., Tort, F. (eds.) ISSEP 2016. LNCS, vol. 9973, pp. 90–101. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46747-4_8

    Chapter  Google Scholar 

  13. Lonati, V., Malchiodi, D., Monga, M., Morpurgo, A.: How presentation affects the difficulty of computational thinking tasks: an IRT analysis. In: Proceedings of the 17th Koli Calling International Conference on Computing Education Research, pp. 60–69. ACM, New York (2017). https://doi.org/10.1145/3141880.3141900

  14. Chiazzese, G., Arrigo, M., Chifari, A., Lonati, V., Tosto, C.: Educational robotics in primary school: measuring the development of computational thinking skills with the Bebras tasks. Informatics 6(4), 43 (2019). https://doi.org/10.3390/informatics6040043

    Article  Google Scholar 

  15. Černochová, M., Vaníček, J.: Informatics education: current state and perspectives of development within the system of field didactics in the Czech Republic. Int. J. Inform. Commun. Technol. Educ. 4(3), 14–31 (2015). https://doi.org/10.1515/ijicte-2015-0011

    Article  Google Scholar 

  16. Dagienė, V., Futschek, G., Stupurienė, G.: Teachers’ constructionist and deconstructionist learning by creating Bebras tasks. In: Sipitakiat, A., Tutiyaphuengprasert, N. (eds.) Constructionism in Action 2016, pp. 257–264. Suksapattana Foundation, Bangkok (2016)

    Google Scholar 

  17. Manabe, H., Tani, S., Kanemune, S., Manabe, Y.: Creating the original Bebras tasks by high school students. Olympiads Inform. 12, 99–110 (2018). https://doi.org/10.15388/ioi.2018.08

    Article  Google Scholar 

  18. Berki, J., Drábková, J.: Základy informatiky pro 2. stupeň ZŠ. Textbook. Technical University of Liberec, Liberec (2020)

    Google Scholar 

  19. Hromkovič, J., Lacher, R.: Einfach informatik. Lösungen finden. Textbook. Klett und Balmer, Baar (2019)

    Google Scholar 

  20. van der Vegt, W., Schrijvers, E.: Analyzing task difficulty in a Bebras contest using cuttle. Olympiads Inform. 13, 145–156 (2019). https://doi.org/10.15388/ioi.2019.09

    Article  Google Scholar 

  21. Yagunova, E., Podznyakov, S., Ryzhova, N., Razumovskaia, E., Korovkin, N.: Tasks classification and age differences in task perception. Case study of international on-line competition “Beaver”. In: Jekovec, M. (ed.) The Proceedings of International Conference on Informatics in Schools: Situation, Evolution and Perspectives, ISSEP 2015, pp. 33–43. University of Ljubljana, Ljubljana (2015)

    Google Scholar 

  22. Bellettini, C., Lonati, V., Malchiodi, D., Monga, M., Morpurgo, A., Torelli, M.: How challenging are Bebras tasks?: an IRT analysis based on the performance of Italian students. In: Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, pp. 27–32. ACM, New York (2015). https://doi.org/10.1145/2729094.2742603

  23. Tort, F., Drot-Delange, B., Mano, M.: Filles et informatique: qu’en est-il du concours Castor?. In: Henry, J., Aude, N., Vandeput, E. (eds.) L’informatique et le numérique en classe. Qui, quoi, comment?, pp. 69–84. Presses Universitaires Namur, Namur (2017)

    Google Scholar 

  24. Hubwieser, P., Hubwieser, E., Graswald, D.: How to attract the girls: gender-specific performance and motivation in the Bebras challenge. In: Brodnik, A., Tort, F. (eds.) ISSEP 2016. LNCS, vol. 9973, pp. 40–52. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46747-4_4

    Chapter  Google Scholar 

  25. Stupurienė, G., Vinikienė, L., Dagienė, V.: Students’ success in the Bebras challenge in Lithuania: focus on a long-term participation. In: Brodnik, A., Tort, F. (eds.) ISSEP 2016. LNCS, vol. 9973, pp. 78–89. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46747-4_7

    Chapter  Google Scholar 

  26. Izu, C., Mirolo, C., Settle, A., Mannila, L., Stupurienė, G.: Exploring Bebras tasks content and performance: a multinational study. Inform. Educ. 16(1), 39–59 (2017). https://doi.org/10.15388/infedu.2017.03

    Article  Google Scholar 

  27. Budinská, L., Mayerová, K., Šimandl, V.: Differences between 9–10 years old pupils’ results from Slovak and Czech Bebras contest. In: Pozdniakov, S.N., Dagienė, V. (eds.) ISSEP 2018. LNCS, vol. 11169, pp. 307–318. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02750-6_24

    Chapter  Google Scholar 

  28. Tomcsányi, P., Vaníček, J.: International comparison of problems from an informatic contest. In: Mechlová, E., Valchař, A. (eds.) Proceedings of the Information and Communication Technology in Education 2009, pp. 219–223. University of Ostrava, Ostrava (2009)

    Google Scholar 

  29. Šimandl, V.: Ochrana osobních údajů podle GDPR v soutěži Bobřík informatiky. In: DidInfo 2019, pp. 146–151. Univerzita Mateja Bela, Banská Bystrica (2019)

    Google Scholar 

  30. Cohen, J.: Statistical Power Analysis for the Behavioral Sciences, 2nd edn. Lawrence Erlbaum Associates, New Jersey (1988)

    MATH  Google Scholar 

  31. Chráska, M.: Metody pedagogického výzkumu, 2nd edn. Grada, Praha (2016)

    Google Scholar 

  32. King, A.P., Eckersley, R.J.: Descriptive statistics II: bivariate and multivariate statistics. In: Statistics for Biomedical Engineers and Scientists, pp. 23–56. Academic Press (2019). https://doi.org/10.1016/b978-0-08-102939-8.00011-6

  33. King, A.P., Eckersley, R.J.: Inferential statistics III: nonparametric hypothesis testing. In: Statistics for Biomedical Engineers and Scientists, pp. 119–145. Academic Press (2019). https://doi.org/10.1016/b978-0-08-102939-8.00015-3

  34. Keller, J., Landhäußer, A.: The flow model revisited. In: Engeser, S. (ed.) Advances in Flow Research. Springer, New York (2012). https://doi.org/10.1007/978-1-4614-2359-1_3

    Chapter  Google Scholar 

  35. Engeser, S., Schiepe-Tiska, A.: Historical Lines and an overview of current research on flow. In: Engeser, S. (ed.) Advances in Flow Research. Springer, New York (2012). https://doi.org/10.1007/978-1-4614-2359-1_1

    Chapter  Google Scholar 

  36. Li, W., Lee, A., Solmon, M.: The role of perceptions of task difficulty in relation to self-perceptions of ability, intrinsic value, attainment value, and performance. Eur. Phys. Educ. Rev. 13(3), 301–318 (2007). https://doi.org/10.1177/1356336X07081797

    Article  Google Scholar 

  37. Mangos, P.M., Steele-Johnson, D.: The role of subjective task complexity in goal orientation, self-efficacy, and performance relations. Hum. Perform. 14(2), 169–185 (2001). https://doi.org/10.1207/S15327043HUP1402_03

    Article  Google Scholar 

  38. Cussó-Calabuig, R., Farran, X.C., Bosch-Capblanch, X.: Are boys and girls still digitally differentiated? The case of Catalonian teenagers. J. Inf. Technol. Educ. Res. 16(1), 411–435 (2017). https://doi.org/10.28945/3879

    Article  Google Scholar 

  39. Birol, C., Bekirogullari, Z., Etci, C., Dagli, G.: Gender and computer anxiety, motivation, self-confidence, and computer use. Eurasian J. Educ. Res. 34, 185–198 (2009)

    Google Scholar 

  40. Vekiri, I.: Boys’ and girls’ ICT beliefs: do teachers matter? Comput. Educ. 55(1), 16–23 (2010). https://doi.org/10.1016/j.compedu.2009.11.013

    Article  Google Scholar 

  41. Dagiene, V., Mannila, L., Poranen, T., Rolandsson, L., Stupuriene, G.: Reasoning on children’s cognitive skills in an informatics contest: findings and discoveries from Finland, Lithuania, and Sweden. In: Gülbahar, Y., Karataş, E. (eds.) ISSEP 2014. LNCS, vol. 8730, pp. 66–77. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-09958-3_7

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jiří Vaníček .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vaníček, J., Šimandl, V. (2020). Participants’ Perception of Tasks in an Informatics Contest. In: Kori, K., Laanpere, M. (eds) Informatics in Schools. Engaging Learners in Computational Thinking. ISSEP 2020. Lecture Notes in Computer Science(), vol 12518. Springer, Cham. https://doi.org/10.1007/978-3-030-63212-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-63212-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-63211-3

  • Online ISBN: 978-3-030-63212-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics