research-article

Playing PISA with bebras

Authors:

Peter Hubwieser,

Andreas MühlingAuthors Info & Claims

WiPSCE '14: Proceedings of the 9th Workshop in Primary and Secondary Computing Education

Pages 128 - 129

https://doi.org/10.1145/2670757.2670759

Published: 05 November 2014 Publication History

Get Access

Abstract

To test and adopt the methodology of future PISA surveys in Computer Science, we have utilized the Bebras Contest as a test field. We performed latent trait analysis of the questions of the German Bebras contest 2009 to find sets of questions that might measure joint psychometric constructs (competencies). After having identified several sets, we have tested the fit of the mono-parametric Rasch Model and evaluated the distribution of person parameters.

References

[1]

E. B. Andersen. A goodness of fit test for the rasch model. Psychometrika 38(1), 123--140, 1973.

Crossref

Google Scholar

[2]

G. Bamberg, F. Baur, and M. Krapp. Statistik. Oldenbourg, München, 2011.

Crossref

Google Scholar

[3]

V. Dagiene. Bebras International Contest on Informatics and Computer Literacy Criteria for Good Tasks. Lecture notes in computer science, No. 5090 (2008),19--30, 2008.

Digital Library

Google Scholar

[4]

P. Hubwieser and A. Mühling. Competency Mining in Large Data Sets - Preparing Large Scale Investigations in Computer Science Education. In Proceedings of the 6th International KDIR -International Conference on Knowledge Discovery and Information Retrieval. Rome, Italy, 21.- 24. October, A. Fred and J. Filipe, Eds. ScitePress, Setúbal, Portugal, to appear, 2014.

Digital Library

Google Scholar

[5]

P. Martin-Löf. Exact tests, confidence regions and estimates. In Proceedings of Conference on Foundational Questions in Statistical Inference. (Aarhus, 1973). Memoirs 1. Univ. Aarhus, Aarhus, 121--138, 1974.

Google Scholar

[6]

D. Rizopoulos. ltm: An R Package for Latent Variable Modeling and Item Response Analysis. Journal of Statistical Software 17(5), 1--25, 2006.

Crossref

Google Scholar

[7]

J. Rost and C. H. Carstensen. Multidimensional Rasch Measurement via Item Component Models and Faceted Designs. Applied Psychological Measurement 26(1), 42--56, 2002.

Crossref

Google Scholar

[8]

F. Schott and and S. Azizi Ghanbari. Modellierung, Vermittlung und Diagnostik der Kompetenz kompetenzorientiert zu unterrichten - wissenschaftliche Herausforderung und ein praktischer Lösungsversuch. Lehrerbildung auf dem Prüfstand 2, 1, 10--27, 2009.

Google Scholar

[9]

T. Seidel and M. Prenzel. Assessment in Large-Scale Studies. In Assessment of competencies in educational contexts, E. Klieme, D. Leutner and J. Hartig, Eds. Hogrefe & Huber Publishers, Toronto, 279--304, 2008.

Google Scholar

[10]

A. Wald. Tests of Statistical Hypotheses Concerning Several Parameters When the Number of Observations is Large. Transactions of the American Mathematical Society 54(3), 426--482, 1943.

Crossref

Google Scholar

Cited By

View all

El-Hamamsy LZapata-Cáceres MMartín-Barroso EMondada FZufferey JBruno BRomán-González M(2025)The Competent Computational Thinking Test (cCTt): A Valid, Reliable and Gender-Fair Test for Longitudinal CT Studies in Grades 3–6Technology, Knowledge and Learning10.1007/s10758-024-09777-8Online publication date: 25-Jan-2025
https://doi.org/10.1007/s10758-024-09777-8
PRŠALA J(2023)PRE-SERVICE TEACHERS AS CURICULLUM DESIGNERS: THE CASE OF BEBRAS TASKSJournal of Technology and Information10.5507/jtie.2023.00615:1(78-94)Online publication date: 20-Oct-2023
https://doi.org/10.5507/jtie.2023.006
Molina-Ayuso ÁAdamuz-Povedano NBracho-López RTorralbo-Rodríguez M(2022)Introduction to Computational Thinking with Scratch for Teacher Training for Spanish Primary School Teachers in MathematicsEducation Sciences10.3390/educsci1212089912:12(899)Online publication date: 8-Dec-2022
https://doi.org/10.3390/educsci12120899
Show More Cited By

Index Terms

Playing PISA with bebras
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Computer science education

Recommendations

Competency Mining in Large Data Sets
IC3K 2014: Proceedings of the International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1

In preparation of large scale surveys on computer science competencies, we are developing proper competency models and evaluation methodologies, aiming to define competencies by sets of exiting questions that are testing congruent abilities. For this ...
Appraisal of course learning outcomes using rasch measurement: a case study in information technology education
SEPADS'08: Proceedings of the 7th WSEAS International Conference on Software Engineering, Parallel and Distributed Systems

The development of Rasch measurement model in social science educational measurement has rapidly expanded to other areas of education including technical and engineering fields. This paper is an attempt of a paradigm shift in testing and evaluation in ...
The Unidimensionality and Local Independence of the Heritage Chinese Language Reading Proficiency Literacy Subtest
ICETC '24: Proceedings of the 2024 16th International Conference on Education Technology and Computers
The aim of this study was to investigate the unidimensionality and local independence properties of the Heritage Chinese Language Reading Proficiency Literacy subtest (HCR-L) for overseas Chinese students through Rasch measurements. The HCR1-L was ...

Comments

Information & Contributors

Information

Published In

WiPSCE '14: Proceedings of the 9th Workshop in Primary and Secondary Computing Education

November 2014

150 pages

ISBN:9781450332507

DOI:10.1145/2670757

Conference Chairs:
Carsten Schulte
Freie Universität Berlin
,
Michael E. Caspersen
Aarhus University
,
Judith Gal-Ezer
The Open University Israel

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2014

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WiPSCE '14

Sponsor:

FU-BERLIN

WiPSCE '14: Workshop in Primary and Secondary Computing Education

November 5 - 7, 2014

Berlin, Germany

Acceptance Rates

Overall Acceptance Rate 104 of 279 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
236
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)4

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

El-Hamamsy LZapata-Cáceres MMartín-Barroso EMondada FZufferey JBruno BRomán-González M(2025)The Competent Computational Thinking Test (cCTt): A Valid, Reliable and Gender-Fair Test for Longitudinal CT Studies in Grades 3–6Technology, Knowledge and Learning10.1007/s10758-024-09777-8Online publication date: 25-Jan-2025
https://doi.org/10.1007/s10758-024-09777-8
PRŠALA J(2023)PRE-SERVICE TEACHERS AS CURICULLUM DESIGNERS: THE CASE OF BEBRAS TASKSJournal of Technology and Information10.5507/jtie.2023.00615:1(78-94)Online publication date: 20-Oct-2023
https://doi.org/10.5507/jtie.2023.006
Molina-Ayuso ÁAdamuz-Povedano NBracho-López RTorralbo-Rodríguez M(2022)Introduction to Computational Thinking with Scratch for Teacher Training for Spanish Primary School Teachers in MathematicsEducation Sciences10.3390/educsci1212089912:12(899)Online publication date: 8-Dec-2022
https://doi.org/10.3390/educsci12120899
El-Hamamsy LZapata-Cáceres MMarcelino PBruno BDehler Zufferey JMartín-Barroso ERomán-González M(2022)Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners' CT test (BCTt) and the competent CT test (cCTt)Frontiers in Psychology10.3389/fpsyg.2022.108265913Online publication date: 12-Dec-2022
https://doi.org/10.3389/fpsyg.2022.1082659
El-Hamamsy LZapata-Cáceres MBarroso EMondada FZufferey JBruno B(2022)The Competent Computational Thinking Test: Development and Validation of an Unplugged Computational Thinking Test for Upper Primary SchoolJournal of Educational Computing Research10.1177/0735633122108175360:7(1818-1866)Online publication date: 19-May-2022
https://doi.org/10.1177/07356331221081753
Guenaga MEguíluz AGaraizar PGibaja J(2021)How do students develop computational thinking? Assessing early programmers in a maze-based online gameComputer Science Education10.1080/08993408.2021.190324831:2(259-289)Online publication date: 13-Apr-2021
https://doi.org/10.1080/08993408.2021.1903248
Kim J(2020)Flipped Learning and Unplugged Activities for Data Structure and Algorithm ClassSoftware Engineering in IoT, Big Data, Cloud and Mobile Computing10.1007/978-3-030-64773-5_8(93-102)Online publication date: 27-Dec-2020
https://doi.org/10.1007/978-3-030-64773-5_8
Martins-Pacheco Lda Cruz Alves Nvon Wangenheim C(2020)Educational Practices in Computational Thinking: Assessment, Pedagogical Aspects, Limits, and Possibilities: A Systematic Mapping StudyComputer Supported Education10.1007/978-3-030-58459-7_21(442-466)Online publication date: 10-Nov-2020
https://doi.org/10.1007/978-3-030-58459-7_21
Bavera FQuintero TDaniele MBuffarini F(2020)Computational Thinking Skills in Primary Teachers: Evaluation Using BebrasComputer Science – CACIC 201910.1007/978-3-030-48325-8_26(405-415)Online publication date: 14-May-2020
https://doi.org/10.1007/978-3-030-48325-8_26
Tsarava KLeifheit LNinaus MRomán-González MButz MGolle JTrautwein UMoeller K(2019)Cognitive Correlates of Computational ThinkingProceedings of the 14th Workshop in Primary and Secondary Computing Education10.1145/3361721.3361729(1-9)Online publication date: 23-Oct-2019
https://dl.acm.org/doi/10.1145/3361721.3361729
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Competency Mining in Large Data Sets

Appraisal of course learning outcomes using rasch measurement: a case study in information technology education

The Unidimensionality and Local Independence of the Heritage Chinese Language Reading Proficiency Literacy Subtest

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations