Abstract
This paper proposes a new approach to find a robot’s current location and to detect any changes in its path, using monocular vision. A recorded single obstacle-free training video is first obtained and saved. Then, a moving robot can use its camera to find its current location, within its path, by matching current frames with the ones from the training video. This frame-to-frame matching is performed using extracted feature points. Once a match is found, the corresponding frames are aligned (registered) using a homography that is calculated based the matched feature points. This allows to compensate for viewpoint changes between the observed and saved frames. Finally, we compare the regions of interest (ROIs) of the aligned frames, using their colour histograms. We carried out seventeen tests using this approach. The videos, for both training and testing, were recorded using off-the-shelf phone camera by walking down different paths. Four tests were performed in an outdoor environment, and 13 in an indoor environment. Our tests have shown excellent results, with an accuracy above 95% for most of them, for finding the robot’s location and for detecting obstacles in the robot’s path. Both training and testing videos used in our tests were realistic and very challenging, as they consisted of a mix of indoor and outdoor environments with cluttered backgrounds, repetitive floor textures and glare.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aleksander, I., Thomas, W., Bowden, P.: Wisard.a radical step forward in image recognition. Sens. Rev. 4, 120–124 (1984). https://doi.org/10.1108/eb007637
Babaee, M., Dinh, D.T., Rigoll, G.: A deep convolutional neural network for video sequence background subtraction. Pattern Recogn. 76(C), 635–649 (2018). https://doi.org/10.1016/j.patcog.2017.09.040
Barnich, O., Droogenbroeck, M.: Vibe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20, 1709–1724 (2011). https://doi.org/10.1109/TIP.2010.2101613
Bianco, S., Ciocca, G., Schettini, R.: How far can you get by combining change detection algorithms? CoRR abs/1505.02921 (2015). http://dblp.uni-trier.de/db/journals/corr/corr1505.html#BiancoCS15a
Braham, M., Droogenbroeck, M.V.: Deep background subtraction with scene-specific convolutional neural networks. In: 2016 International Conference on Systems, Signals and Image Processing (IWSSIP), pp. 1–4 (2016)
Chen, S., Zhang, J., Li, Y., Zhang, J.: A hierarchical model incorporating segmented regions and pixel descriptors for video background subtraction. IEEE Trans. Ind. Inf. 8, 118–127 (2012). https://doi.org/10.1109/TII.2011.2173202
Cheng, L., Gong, M.: Realtime background subtraction from dynamic scenes, pp. 2066–2073 (2009). https://doi.org/10.1109/ICCV.2009.5459454
De Gregorio, M., Giordano, M.: Change detection with weightless neural networks, June 2014. https://doi.org/10.1109/CVPRW.2014.66
Jia, B., Liu, R., Zhu, M.: Real-time obstacle detection with motion features using monocular vision. Vis. Comput. 31(3), 281–293 (2015). https://doi.org/10.1007/s00371-014-0918-5
Kompella, V., Bidargaddi, S.V., Kaipa, K., Ghose, D.: A tracked mobile robot with vision-based obstacle avoidance, pp. 12–13, January 2008
Lacassagne, L., Manzanera, A., Dupret, A.: Motion detection: fast and robust algorithms for embedded systems, pp. 3265–3268, December 2009. https://doi.org/10.1109/ICIP.2009.5413946
Lee, T., Yi, D.H., Dan Cho, D.I.: A monocular vision sensor-based obstacle detection algorithm for autonomous robots. Sensors 16, 311 (2016). https://doi.org/10.3390/s16030311
Li, Y., Birchfield, S.T.: Image-based segmentation of indoor corridor floors for a mobile robot, pp. 837–843, November 2010. https://doi.org/10.1109/IROS.2010.5652818
Lorigo, L., Brooks, R., Grimsou, W.: Visually-guided obstacle avoidance in unstructured environments, vol. 1, pp. 373–379, October 1997. https://doi.org/10.1109/IROS.1997.649086
Mandellos, N.A., Keramitsoglou, I., Kiranoudis, C.T.: A background subtraction algorithm for detecting and tracking vehicles. Expert Syst. Appl. 38(3), 1619–1631 (2011). https://doi.org/10.1016/j.eswa.2010.07.083
Manzanera, A., Richefeu, J.C.: A robust and computationally efficient motion detection algorithm based on sigma-delta background estimation, pp. 46–51, December 2004
Michels, J., Saxena, A., Ng, A.Y.: High speed obstacle avoidance using monocular vision and reinforcement learning. In: Proceedings of the 22nd International Conference on Machine Learning, ICML 2005, pp. 593–600. ACM, New York (2005). https://doi.org/10.1145/1102351.1102426
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF, pp. 2564–2571, November 2011. https://doi.org/10.1109/ICCV.2011.6126544
St-Charles, P.L., Bilodeau, G.A., Bergevin, R.: Flexible background subtraction with self-balanced local sensitivity, June 2014. https://doi.org/10.1109/CVPRW.2014.67
Stauffer, C., E. L. Grimson, W.: Adaptive background mixture models for real-time tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, January 2007
Ulrich, I., Nourbakhsh, I.R.: Appearance-based obstacle detection with monocular color vision. In: Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, pp. 866–871. AAAI Press (2000). http://dl.acm.org/citation.cfm?id=647288.721755
Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction, vol. 2, pp. 28–31, September 2004. https://doi.org/10.1109/ICPR.2004.1333992
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Bluteau, R., Boufama, B., Habashi, P. (2020). Determining Location and Detecting Changes Using a Single Training Video. In: Djeddi, C., Jamil, A., Siddiqi, I. (eds) Pattern Recognition and Artificial Intelligence. MedPRAI 2019. Communications in Computer and Information Science, vol 1144. Springer, Cham. https://doi.org/10.1007/978-3-030-37548-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-37548-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37547-8
Online ISBN: 978-3-030-37548-5
eBook Packages: Computer ScienceComputer Science (R0)