Abstract
In recent years, Autonomous Underwater Vehicles (AUVs) have been used extensively to gather imagery and other environmental data for ocean monitoring. Processing of this vast amount of collected imagery to label content is difficult, expensive and time consuming. Because of this, typically only a small subset of images are labelled, and only at a small number of points. In order to make full use of the raw data returned from the AUV, this labelling process needs to be automated. In this work the single species classification problem of [1] is extended to a multi-species classification problem following a taxonomical hierarchy. We demonstrate the application of techniques used in areas such as computer vision, text classification and medical diagnosis to the supervised hierarchical classification of benthic images. After making a comparison to flat multi-class classification, we also discuss critical aspects such as training topology and various prediction and scoring methodologies. An interesting aspect of the presented work is that the ground truth labels are sparse and incomplete, i.e. not all labels go to the leaf node, which brings with it other interesting challenges.We find that the best classification results are obtained using Local Binary Patterns (LBP), training a network of binary classifiers with probabilistic output, and applying “one-vs-rest” classification at each level of the hierarchy for prediction. This work presents a working solution that allows AUV images to be automatically labelled with the most appropriate node in a hierarchy of 19 biological groupings and morphologies. The result is that the output of the AUV system can include a semantic map using the taxonomy prescribed by marine scientists. This has the potential to not only reduce the manual labelling workload, but also to reduce the current dependence that marine scientists have on extrapolating information from a relatively small number of sparsely labelled points.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bewley, M., Douillard, B., Nourani-Vatani, N., Friedman, A., Pizarro, O., Williams, S.: Automated species detection: An experimental approach to kelp detection from sea-floor AUV images (December 2012)
Williams, S., Pizarro, O., Jakuba, M., Johnson, C., Barrett, N., Babcock, R., Kendrick, G., Steinberg, P., Heyward, A., Doherty, P., Mahon, I., Johnson-Roberson, M., Steinberg, D., Friedman, A.: Monitoring of benthic reference sites: Using an autonomous underwater vehicle. IEEE Robotics and Automation Magazine 19(1), 73–84 (2012)
Smith, D., Dunbabin, M.: Automated counting of the northern pacific sea star in the derwent using shape recognition. In: The Australasian Conference on Robotics & Automation (ACRA), pp. 500–507 (December 2007)
Steinberg, D., Friedman, A., Pizarro, O., Williams, S.: A bayesian nonparametric approach to clustering data from underwater robotic surveys. In: International Symposium on Robotics Research (ISRR) (August 2011)
National environmental research program (NERP) marine biodiversity hub, scored autonomous underwater vehicle imagery, east tasmania 2008-2010 (2010), http://marine.acfr.usyd.edu.au/datasets
Kohler, K.E., Gill, S.M.: Coral point count with excel extensions (CPCe): a visual basic program for the determination of coral and substrate coverage using random point count methodology. Computers & Geosciences 32(9), 1259–1269 (2006), http://www.sciencedirect.com/science/article/pii/S0098300405002633
Denuelle, A., Dunbabin, M.: Kelp detection in highly dynamic environments using texture recognition. In: The Australasian Conference on Robotics & Automation (ACRA) (December 2010)
Beijbom, O., Edmunds, P., Kline, D., Mitchell, B., Kriegman, D.: Automated annotation of coral reef survey images. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p. 1170 (2012)
Mehta, A., Ribeiro, E., Gilner, J., van Woesik, R.: Coral reef texture classification using support vector machines. VISAPP (2), 302–310 (2007)
Silla Jr., C.N., Freitas, A.A.: A survey of hierarchical classification across different application domains. Data Mining and Knowledge Discovery 22(1-2), 31–72 (2011)
Fagni, T., Sebastiani, F.: On the selection of negative examples for hierarchical text categorization. In: Proceedings of the 3rd Language & Technology Conference (LTC 2007), pp. 24–28 (2007)
Kiritchenko, S., Matwin, S., Nock, R., Famili, A.F.: Learning and evaluation in the presence of class hierarchies: application to text categorization. In: Lamontagne, L., Marchand, M. (eds.) Canadian AI 2006. LNCS (LNAI), vol. 4013, pp. 395–406. Springer, Heidelberg (2006)
Ojala, T., Pietikaeinen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(7), 971–987 (2002)
Ahonen, T., Matas, J., He, C., Pietikäinen, M.: Rotation invariant image description with local binary pattern histogram fourier features. In: Salberg, A.-B., Hardeberg, J.Y., Jenssen, R. (eds.) SCIA 2009. LNCS, vol. 5575, pp. 61–70. Springer, Heidelberg (2009)
Krizhevsky, A., Hinton, G.: Learning multiple layers of features from tiny images. Master’s thesis, Department of Computer Science, University of Toronto (2009)
Coates, A., Lee, H., Ng, A.Y.: An analysis of single-layer networks in unsupervised feature learning. In: Proceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS), vol. 15 (2011)
Barrett, N., Meyer, L., Hill, N., Walsh, P.: Methods for the processing and scoring of AUV digital imagery from south eastern tasmania. University of Tasmania, Technical Report 11560 (August 2011), http://eprints.utas.edu.au/11560/
Edwards, L.: Release of CATAMI classification scheme (February 2013), http://catami-australia.blogspot.com.au/
IMOS: integrated marine observing system (September 2013), http://www.imos.org.au
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Bewley, M.S., Nourani-Vatani, N., Rao, D., Douillard, B., Pizarro, O., Williams, S.B. (2015). Hierarchical Classification in AUV Imagery. In: Mejias, L., Corke, P., Roberts, J. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 105. Springer, Cham. https://doi.org/10.1007/978-3-319-07488-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-07488-7_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07487-0
Online ISBN: 978-3-319-07488-7
eBook Packages: EngineeringEngineering (R0)