Abstract
Safety critical railway assets need to be visible from prescribed distances, ensuring safety. Traditional methods for measuring these sighting distances involve manual labour and disruption of rail services. Drawing parallels with other areas, efficiency and cost of such a task can be improved with automation. Hence, in this work, we describe a framework providing such automation, using image frames captured from video equipment as input. Any such framework needs to meet a set of associated challenges, including: determining the image position of decreasing sized assets as they appear farther from the observer, extracting three-dimensional positioning information (relative to motion) from two-dimensional video information and determining when an asset can no longer be seen (i.e. the sighting distance). Results show that the methods included in this framework perform better than a traditional method and information regarding asset-sighting distance is accurately computed.
Similar content being viewed by others
References
Badino H (2007) A robust approach for ego-motion estimation using a mobile stereo platform. In: Lecture Notes in Computer Science, pp 198–208
Bennamoun M, Mamic GJ (2002) Object recognition: fundamentals and case studies. Springer, Berlin
Besl PJ, McKay ND (1992) A method for registration of 3-d shapes. IEEE Trans Pattern Anal Mach Intell 14:239–256
Ramesh V, Comaniciu D, Meer P (2000) Real-time tracking of non-rigid objects using mean shift. In: IEEE CVPR, pp 1–8
Dornaika F, Chung CR (2003) Stereo geometry from 3d ego-motion streams. In IEEE Trans Syst Man Cybern Part B, 308–323
Douxchamps D, Chihara K (2009) High-accuracy and robust localization of large control markers for geometric camera calibration. IEEE Trans Pattern Anal Mach Intell 31:376–383
Dubbelman G, van der Mark W, Groen FCA (2008) Accurate and robust ego-motion estimation using expectation maximization. In: IEEE/RSJ international conference on intelligent robots and systems, pp 3914–3920
Fanany MI, Kumazawa I (2004) A neural network for recovering 3d shape from erroneous and few depth maps of shaded images. Pattern Recognit Lett 25:377–389
Foucher P, Charbonnier P, Kebbous H (2009) Evaluation of a road sign pre-detection system by image analysis. In: VISAPP 2009, pp 362–367
Gang T, Rui-Min H, Zhong-Yuan W, Li Z (2009) Object track-ing algorithm based on meanshift algorithm combining with motion vector analysis. In: 2009 first international workshop on education technology and computer science, pp 987–990
Gao S, Zhao M, Zhang L, Zou Y (2008) Dual-beam structured light vision system for 3d coordinates measurement. In: Proceedings of the 7th world congress on intelligent control and automation, pp 3687–3691
Goecke R, Asthana A, Pettersson N, Petersson L (2007) Visual vehicle egomotion esitmation using the Fourier-mellin transform. In: IEEE intelligent vehicles symposium, pp 450–455
Gonzalez RC, Woods RE (2002) Digital image processing. Prentice Hall Inc., Upper Saddle River
Griesser A, Koninckx TP, Van Gool L (2004) Adaptive real-time 3d acquisition and contour tracking within a multiple structured light system. In: Proceedings 12th Pacific conference on computer graphics and applications, pp 361–370
Guo X, Wang C, Qu Z (2007) Object tracking for autonomous mobile robot based on feedback of monocular-vision. In: 2nd IEEE conference on industrial electronics and applications, 2007. ICIEA 2007, pp 467–470
Hanna KJ (1991) Direct multi-resolution estimation of ego-motion and structure from motion. In: Proceedings of the IEEE workshop on visual motion, 1991, pp 156–162
Hartley R, Zisserman A (2006) Multiple view geometry in computer vision. Cambridge University Press, Cambridge
Hong S, Atkins E (2008) Moving sensor video image processing enhanced with elimination of ego motion by global registration and sift. In: 20th IEEE international conference on tools with artificial intelligence, pp 37–40
Howard A (2008) Real-time stereo visual odometry for autonomous ground vehicles. In: IEEE/RSJ international conference on intelligent robots and systems, pp 3946–3952
Ito K, Aoki T, Kawamata R, Kashima I (2008) Medical image registration using phase-only correlation for distorted dental radiographs. In: 19th international conference on pattern recognition, pp 1–4
Jirawimut R, Prakoonwit S, Cecelja F, Balachandran W (2003) Visual odometer for pedestrian navigation. In: Proceedings of the 19th IEEE instrumentation and measurement technology conference, 2002. IMTC/2002, vol 1, pp 43–48
Kmiotek P, Ruichek Y (2008) Representing and tracking o dynamics objects using oriented bounding box and extended Kalman filter. In: Proceedings of the 11th international IEEE conference on intelligent transportation systems, pp 322–328
Lafuente-Arroyo S, Maldonado-Bascon S, Gil-Jimenez P, Gomez-Moreno H, Lopez-Ferreras F (2006) Road sign tracking with a predictive filter solution. In IECON 2006, 32nd annual conference on IEEE industrial electronics, pp 3314–3319
Lavoie P, Ionescu D, Petriu F (2004) 3-d object model recovery from 2-d images using structured light. In IEEE Trans Instrum Meas 53:437–443
Levin A, Szeliski R (2004) Visual odometry and map correlation. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition (CVPR’04), vol 1, pp 611–618
Lin X, Zeng J, Yao Q (1996) Optimal sensor planning with minimal cost for 3d object recognition using sparse structured light images. In: Proceedings of the 1996 IEEE international conference on robotics and automation, pp 3484–3489
Liu G-H, Feng Q-Y (2009) Recovering 3d shape and motion from image sequences using affine approximation. In: Second international conference on information and computing science, pp 349–352
James MacLean W, Jepson AD, Frecker RC (1994) Recovery of egomotion and segmentation of independent object motion using the em algorithm. In: Proceedings of the 5th British machine vision conference, BMVA Press, pp 175–184
Miyasaka T, Ohama Y, Ninomiya Y (2009) Ego-motion estimation and moving object tracking using multi-layer lidar. In: IEEE intelligent vehicles symposium, pp 151–156
Ni K, Dellaert F (2006) Stereo tracking and three-point/one-point algorithms—a robust approach in visual odometry. In: IEEE international conference on image processing, pp 2777–2780
Olson CF, Matthies LH, Schoppers M, Maimone MW (2000) Robust stereo ego-motion for long distance navigation. In: Proceedings of IEEE conference on computer vision and pattern recognition, 2000, vol 2, pp 453–458
Olson CF, Matthies LH, Schoppers M, Maimone MW (2001) Stereo ego-motion improvements for robust rover navigation. In: Proceedings of the 2001 IEEE international conference on robotics and automation, pp 1099–1104
Park DK, Yoon HS, Won CS (2000) Fast object tracking in digital video. IEEE Trans Consum Electron 46:785–790
Pink O (2008) Visual map matching and localization using a global feature map. In: IEEE computer society conference on computer vision and pattern recognition workshops, 2008. CVPRW’08, pp 1–7
Pink O, Moosman F, Bachmann A (2009) Visual features for vehicle localization and ego-motion estimation. In: IEEE intelligent vehicles symposium, pp 254–260
Premebida C, Nunes U (2006) A multi-target tracking and gmm-classifier for intelligent vehicles. In: Proceedings of the IEEE intelligent transportation systems conference, pp 313–318
Ruta A, Li Y, Liu X (2008) Detection, tracking and recognition of traffic signs from video input. In: Proceedings of the 11th international IEEE conference on intelligent transportation systems, pp 55–60
Sato T, Saito H, Ozawa S (2000) 3d shape recovery of non-convex object from rotation. In Proceedings of the 15th international conference on pattern recognition, vol 1, pp 742–745
Schmitt F, Yemez Y (1999) 3d color object reconstruction from 2d image sequences. In: Proceedings international conference on image processing, 1999. ICIP 99, vol 3, pp 65–69
Schon TB, Roll J (2009) Ego-motion and indirect road geometry estimation using night vision. In IEEE intelligent vehicles symposium, pp 30–35
Seki A, Okutomi M (2006) Ego-motion estimation by matching dewarped road regions using stereo images. In Proceedings of the 2006 IEEE international conference on robotics and automation, pp 901–907
Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical report, International Computer Science Institute
Szeliski R, Kang SB (1993) Recovering 3d shape and motion from image streams using non-linear least squares. Technical report, Cambridge Research Lab
Tsuchiya K, Hashimoto S, Matsushima T (1994) A pixel voting method to recover 3d object shape from 2d images. In: MVA’94 IAPR workshop on machine vision applications, pp 111–114
Wei B, Fan Y, Gao B (2009) Mobile robot vision system based on linear structured light and dsp. In: Proceedings of the 2009 IEEE international conference on mechatronics and automation, pp 1285–1290
Wei B, Gao J, Li K, Fan Y, Gao X, Gao B (2008) Indoor mobile robot obstacle detection based on linear structured light vision system. In: Proceedings of the 2008 IEEE international conference on robotics and biometrics, pp 834–839
Wen Z, Cai Z (2007) A robust object tracking approach using mean-shift. In: Third international conference on natural computation (ICNC 2007), vol 2, pp 170–174
Yamaguchi K, Kato T, Ninomiya Y (2006) Vehicle ego-motion esitmation and moving object detection using a monocular camera. In: The 18th international conference on pattern recognition (ICPR’06), pp 610–613
Yamaguchi K, Kato T, Ninomiya Y (2006) Vehicle ego-motion estimation and moving object detection using a monocular camera. In: The 18th international conference on pattern recognition (ICPR’06), vol 4, pp 610–613
Yilmaz A, Shafique K, Lobo N, Li X, Olson T, Shah MA (2001) Target-tracking in flir imagery using mean-shift and global motion compensation. In: Workshop on computer vision beyond the visible spectrum, Kauai, pp 54–58
Zhang Z (1998) A flexible new technique for camera calibration. Technical report, Microsoft Research, Microsoft Corporation
Zhao Z, Liu Y, Zhang Z (2008) Camera calibration with three noncollinear points under special motions. In: IEEE transactions on image processing, vol 17, pp 2393–2402
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Warsop, T., Singh, S. A framework for computing asset-sighting distance. Pattern Anal Applic 15, 427–444 (2012). https://doi.org/10.1007/s10044-012-0268-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-012-0268-8