Abstract
Vegetation growing on railway trackbeds and embankments can present several potential problems. Consequently, such vegetation is controlled through various maintenance procedures. In order to investigate the extent of maintenance needed, one of the first steps in any maintenance procedure is to monitor or inspect the railway section in question. Monitoring is often carried out manually by sending out inspectors or by watching recorded video clips of the section in question. To facilitate maintenance planning, the ability to assess the extent of vegetation becomes important. This paper investigates the reliability of human assessments of vegetation on railway trackbeds.
In this study, five maintenance engineers made independent visual estimates of vegetation cover and counted the number of plant clusters from images.
The test results showed an inconsistency between the raters when it came to visually estimating plant cover and counting plant clusters. The results showed that caution should be exercised when interpreting individual raters’ assessments of vegetation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Coulloudon, B., Eshelman, K., Gianola, J., Habich, N., et al.: Sampling vegetation attributes. Interagency Technical Reference BLM/RS/ST-96/002+1730, Bureau of Land Management’s National Applied Resource Sciences Center, BC-650B. P.O. Box 25047. Denver, Colorado 80225–0047 (1999)
Elzinga, C.L., Salzer, D.W., Willoughbyh, J.W.: Measuring and monitoring plant populations. Technical Reference 1730–1 BLM/RS/ST-98/005+1730 (5.1 MB), Bureau of Land Management. Denver, Colorado. USDI, BLM (1998)
Yella, S., Nyberg, R.G., Gupta, N., Dougherty, M.: Reliability of manual assessments in determining the types of vegetation on railway trackbeds. In: The 3rd International Workshop on Data Quality and Trust in Big Data (QUAT 2015) with the 16th International Conference on Web Information Systems Engineering (WISE 2015), Miami, Florida (2015)
Krippendorff, K.: Recent developments in reliability analysis. In: Annual Meeting of the International Communication Association, Miami, FL, 21–25 May 1992
Nyberg, R.G., Gupta, N.K., Yella, S., Dougherty, M.S.: Machine vision for condition monitoring vegetation on railway embankments. In: 6th IET Conference on Railway Condition Monitoring (RCM 2014), pp. 1–7, September 2014
Nyberg, R.G., Gupta, N.K., Yella, S., Dougherty, M.S.: Monitoring vegetation on railway embankments: supporting maintenance decisions. In: Proceedings of the International Conference on Ecology and Transportation, July 2013
Shoukri, M.M.: Measures of Interobserver Agreement and Reliability. CRC Press, Boca Raton (2003)
Martin, P., Bateson, P.: Measuring Behaviour: An Introductory Guide. Cambridge University Press, Cambridge (2007)
Rankin, G., Stokes, M.: Reliability of assessment tools in rehabilitation: an illustration of appropriate statistical analyses. Clin. Rehabil. 12(3), 187–199 (1998)
Hallgren, K.A.: Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials Quant. Methods Psychol. 8(1), 23–34 (2012)
Cicchetti, D.V.: Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assess. 6(4), 284–290 (1994)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Nyberg, R.G., Yella, S., Gupta, N.K., Dougherty, M. (2015). Inter-rater Reliability in Determining the Types of Vegetation on Railway Trackbeds. In: Wang, J., et al. Web Information Systems Engineering – WISE 2015. WISE 2015. Lecture Notes in Computer Science(), vol 9419. Springer, Cham. https://doi.org/10.1007/978-3-319-26187-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-26187-4_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26186-7
Online ISBN: 978-3-319-26187-4
eBook Packages: Computer ScienceComputer Science (R0)