Skip to main content

Predictive Validity of Tracking Decisions: Application of a New Validation Criterion

  • Conference paper
  • First Online:
Data Analysis, Machine Learning and Knowledge Discovery

Abstract

Although tracking decisions are primarily based on students’ achievements, distributions of academic competences in secondary school strongly overlap between school tracks. However, the correctness of tracking decisions usually is based on whether or not a student has kept the track she or he was initially assigned to. To overcome the neglect of misclassified students, we propose an alternative validation criterion for tracking decisions. We applied this criterion to a sample of N = ;2, ;300 Luxembourgish 9th graders in order to identify misclassifications due to tracking decisions. In Luxembourg, students in secondary school attend either an academic track or a vocational track. Students’ scores of academic achievement tests were obtained at the beginning of 9th grade. The test-score distributions, separated by tracks, overlapped to a large degree. Based on the distributions’ intersection, we determined two competence levels. With respect to their individual scores, we assigned each student to one of these levels. It turned out that about 21 % of the students attended a track that did not match their competence level. Whereas the agreement between tracking decisions and actual tracks in 9th grade was fairly high (κ = 0. 93), the agreement between tracking decisions and competence levels was only moderate (κ = 0. 56).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bos, W., & Gröhlich, C. (2010). Kompetenzen und Einstellungen von Schülerinnen und Schülern am Ende der Jahrgangsstufe (Vol. 8). Münster: Waxmann.

    Google Scholar 

  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.

    Article  Google Scholar 

  • Drasgow, F., & Hulib, C. L. (1990). Item response theory. In M. D. Dunnette, & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 1). Mountain View: Davies-Black Pub.

    Google Scholar 

  • Inman, H. F., & Bradley, E. L. (1989). The overlapping coefficient as a measure of agreement between probability distributions and point estimation of the overlap of two normal densities. Communications in Statistics–Theory and Methods, 18, 3851–3874.

    Google Scholar 

  • Jussim, L., & Eccles, J. S. (1992). Teacher expectations II: Construction and reflection of student achievement. Journal of Personality and Social Psychology, 63, 947–961.

    Article  Google Scholar 

  • Ministere de l’Education Nationale et de la Formation Professionelle (2010). Nationaler Bericht Epreuves Standardisees (EpStan). Luxembourg: MENFP.

    Google Scholar 

  • Schlechty, P. C. (1976) Teaching and social behavior: Toward an organizational theory of instruction. Boston: Ally and Bacon.

    Google Scholar 

Download references

Acknowledgements

This study was supported by grant F3R-LCM-PFN-11PREV from the Fonds National de la Recherche Luxembourg. We are grateful to Martin Brunner who provided us with the test results.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Florian Klapproth .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Klapproth, F., Krolak-Schwerdt, S., Hörstermann, T., Martin, R. (2014). Predictive Validity of Tracking Decisions: Application of a New Validation Criterion. In: Spiliopoulou, M., Schmidt-Thieme, L., Janning, R. (eds) Data Analysis, Machine Learning and Knowledge Discovery. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Cham. https://doi.org/10.1007/978-3-319-01595-8_7

Download citation

Publish with us

Policies and ethics