Abstract
Although tracking decisions are primarily based on students’ achievements, distributions of academic competences in secondary school strongly overlap between school tracks. However, the correctness of tracking decisions usually is based on whether or not a student has kept the track she or he was initially assigned to. To overcome the neglect of misclassified students, we propose an alternative validation criterion for tracking decisions. We applied this criterion to a sample of N = ;2, ;300 Luxembourgish 9th graders in order to identify misclassifications due to tracking decisions. In Luxembourg, students in secondary school attend either an academic track or a vocational track. Students’ scores of academic achievement tests were obtained at the beginning of 9th grade. The test-score distributions, separated by tracks, overlapped to a large degree. Based on the distributions’ intersection, we determined two competence levels. With respect to their individual scores, we assigned each student to one of these levels. It turned out that about 21 % of the students attended a track that did not match their competence level. Whereas the agreement between tracking decisions and actual tracks in 9th grade was fairly high (κ = 0. 93), the agreement between tracking decisions and competence levels was only moderate (κ = 0. 56).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bos, W., & Gröhlich, C. (2010). Kompetenzen und Einstellungen von Schülerinnen und Schülern am Ende der Jahrgangsstufe (Vol. 8). Münster: Waxmann.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
Drasgow, F., & Hulib, C. L. (1990). Item response theory. In M. D. Dunnette, & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 1). Mountain View: Davies-Black Pub.
Inman, H. F., & Bradley, E. L. (1989). The overlapping coefficient as a measure of agreement between probability distributions and point estimation of the overlap of two normal densities. Communications in Statistics–Theory and Methods, 18, 3851–3874.
Jussim, L., & Eccles, J. S. (1992). Teacher expectations II: Construction and reflection of student achievement. Journal of Personality and Social Psychology, 63, 947–961.
Ministere de l’Education Nationale et de la Formation Professionelle (2010). Nationaler Bericht Epreuves Standardisees (EpStan). Luxembourg: MENFP.
Schlechty, P. C. (1976) Teaching and social behavior: Toward an organizational theory of instruction. Boston: Ally and Bacon.
Acknowledgements
This study was supported by grant F3R-LCM-PFN-11PREV from the Fonds National de la Recherche Luxembourg. We are grateful to Martin Brunner who provided us with the test results.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Klapproth, F., Krolak-Schwerdt, S., Hörstermann, T., Martin, R. (2014). Predictive Validity of Tracking Decisions: Application of a New Validation Criterion. In: Spiliopoulou, M., Schmidt-Thieme, L., Janning, R. (eds) Data Analysis, Machine Learning and Knowledge Discovery. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Cham. https://doi.org/10.1007/978-3-319-01595-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-01595-8_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01594-1
Online ISBN: 978-3-319-01595-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)