Abstract
This paper provides an image processing framework to assist in the inspection and, more generally, the data association of a natural environment, which we demonstrate in a long-term lakeshore monitoring task with an autonomous surface vessel. Our domain consists of 55 surveys of a 1 km lakeshore collected over a year and a half. Our previous work introduced a framework in which images of the same scene from different surveys are aligned using visual SLAM and SIFT Flow. This paper: (1) minimizes the number of expensive image alignments between two surveys using a covering set of poses, rather than all the poses in a sequence; (2) improves alignment quality using a local search around each pose and an alignment bias derived from the 3D information from visual SLAM; and (3) provides exhaustive results of image alignment quality. Our improved framework finds significantly more precise alignments despite performing image registration over an order of magnitude fewer times. We show changes a human spotted between surveys that would have otherwise gone unnoticed. We also show cases where our approach was robust to ‘extreme’ variation in appearance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beall, C., Dellaert, F.: Appearance-based localization across seasons in a Metric Map. In: 6th PPNIV, Chicago, Sept 2014
Churchill, W., Newman, P.: Experience-based navigation for long-term localisation. IJRR 32(14), 1645–1661 (2013)
Chvatal, V.: A greedy heuristic for the set-covering problem. Math. Oper. Res. 4(3), 233–235 (1979)
Corke, P., Paul, R., Churchill, W., Newman, P.: Dealing with shadows: capturing intrinsic scene appearance for image-based outdoor localization. In: IROS, pp. 2085–2092. IEEE (2013)
Dellaert, F.: Factor Graphs and GTSAM: A Hands-on Introduction. Technical report GT-RIM-CP&R-2012-002, GT RIM, Sept 2012. https://research.cc.gatech.edu/borg/sites/edu.borg/files/downloads/gtsam.pdf
Griffith, A., Drews, P., Pradalier, C.: Towards autonomous lakeshore monitoring. In: ISER (2014)
Griffith, S., Dellaert, F., Pradalier, C.: Robot-enabled lakeshore monitoring using visual SLAM and SIFT flow. In: RSS Workshop on Multi-View Geometry in Robotics (2015)
Gu, J., Ramamoorthi, R., Belhumeur, P., Nayar, S.: Removing image artifacts due to dirty camera lenses and thin occluders. ACM Trans. Graph. (TOG) 28(5), 144 (2009)
He, X., Zemel, R., Mnih, V.: Topological map learning from outdoor image sequences. JFR 23(11–12), 1091–1104 (2006)
Heidarsson, H., Sukhatme, G.: Obstacle detection from overhead imagery using self-supervised learning for autonomous surface vehicles. In: IROS, pp. 3160–3165. IEEE (2011)
Hitz, G., Pomerleau, F., Colas, F., Siegwart, R.: State estimation for shore monitoring using an autonomous surface vessel. In: ISER (2014)
Jain, S., Nuske, S.T., Chambers, A.D., Yoder, L., Cover, H., Chamberlain, L.J., Scherer, S., Singh, S.: Autonomous river exploration. In: FSR, Dec 2013
Kaess, M., Johannsson, H., Roberts, R., Ila, V., Leonard, J.J., Dellaert, F.: iSAM2: incremental smoothing and mapping using the Bayes tree. IJRR, 31(2), 216–235 (2012)
Košecka, J.: Detecting changes in images of street scenes. In: Computer Vision-ACCV 2012, vol. 7727 of LNCS, pp. 590–601. Springer (2013)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. In: ACM Transactions on Graphics (ToG), vol. 22, pp. 277–286. ACM (2003)
Liu, C., Yuen, J., Torralba, A.: SIFT flow: dense correspondence across scenes and its applications. PAMI 33(5), 978–994 (2011)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis.60(2), 91–110 (2004)
McManus, C., Upcroft, B., Newman, P.: Scene signatures: localized and point-less features for localization. In: RSS, Berkeley (2014)
Nelson, P., Churchill, W., Posner, I., Newman, P.: From dusk till dawn: localisation at night using artificial light sources. In: ICRA (2015)
Neubert, P., Sünderhauf, N., Protzel, P.: Superpixel-based appearance change prediction for long-term navigation across seasons. In: RAS (2014)
Rogers, J., Christensen, H.: Normalized graph cuts for visual slam. In: IROS, pp. 918–923. IEEE (2009)
Sibley, G., Mei, C., Reid, I., Newman, P.: Vast-scale outdoor navigation using adaptive relative bundle adjustment. IJRR 29(8), 958–980 (2010)
Subramanian, A., Gong, X., Riggins, J., Stilwell, D., Wyatt, C.: Shoreline mapping using an omni-directional camera for autonomous surface vehicle applications. In: OCEANS, pp 1–6. IEEE (2006)
Acknowledgments
Funding for this project is provided by the Lorraine Region, France.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Griffith, S., Pradalier, C. (2016). A Spatially and Temporally Scalable Approach for Long-Term Lakeshore Monitoring. In: Wettergreen, D., Barfoot, T. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 113. Springer, Cham. https://doi.org/10.1007/978-3-319-27702-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-27702-8_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27700-4
Online ISBN: 978-3-319-27702-8
eBook Packages: EngineeringEngineering (R0)