Abstract
This paper presents an original Augmented-Reality system to automatically identify aquarium fish species, providing a rich multimedia experience to customers. Our goal is to replace the signs placed near tanks in aquariums with a smartphone application based on image-processing. Our system is grounded on the Active Appearance Model for fish texture sampling. This paper also introduces a novel AAM matching function that measures the superimposition degree of the AAM instance edges and the targets’ edges. The newly defined function significantly improves the AAM matching performance on textureless targets without modifying the computational cost. We evaluate our identification algorithm quantitatively on a comprehensive synthetic data set of static images, whereas we evaluate the usability of our AR system in real conditions qualitatively. It yields a 94% correct-identification rate on 15 species and runs up to 15 frames per second on an iPod Touch 4G, ensuring a satisfying user experience.
The guessing game (Dory and Marlin), Finding Nemo, 2003.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Larsen, R., Olafsdottir, H., Ersbøll, B.K.: Shape and Texture Based Classification of Fish Species. In: Salberg, A.-B., Hardeberg, J.Y., Jenssen, R. (eds.) SCIA 2009. LNCS, vol. 5575, pp. 745–749. Springer, Heidelberg (2009)
Rova, A., Mori, G., Dill, L.M.: One fish, two fish, butterfish, trumpeter: Recognizing fish in underwater video. In: IAPR Conference on Machine Vision Applications, pp. 404–407 (2007)
Spampinato, C., Giordano, D., Salvo, R.D., Heh Chen-burger, Y., Fisher, R.B., Nadarajan, G.: Automatic fish classification for underwater species behavior understanding. In: Proceedings of the First ACM International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams, ARTEMIS 2010, pp. 45–50 (2010)
Semani, D., Bouwmans, T., Frelicot, C., Courtellemont, P.: Automatic fish recognition in interactive live videos. In: International Workshop on Interactive Video between Research and Industrial Applications, IVRCIA, vol. XIV, pp. 94–99 (2002)
Semani, D., Saint-Jean, C., Frélicot, C., Bouwmans, T., Courtellemont, P.: Alive Fishes Species Characterization from Video Sequences. In: Caelli, T.M., Amin, A., Duin, R.P.W., Kamel, M.S., de Ridder, D. (eds.) SSPR&SPR 2002. LNCS, vol. 2396, pp. 689–698. Springer, Heidelberg (2002)
Benson, B., Cho, J., Goshorn, D., Kastne, R.: Field programmable gate array based fish detection using haar classifiers. American Academy of Underwater Science (2009)
Tillett, R., Mcfarlane, N., Lines, J.: Estimating dimensions of free-swimming fish using 3d point distribution models. Computer Vision and Image Understanding 79, 123–141 (2000)
Quivy, C.H., Kumazawa, I.: Normalization of active appearance models for fish species identification. In: ISRN Signal Processing, vol. 2011 (2011)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 681–685 (2001)
Aidarous, Y., Séguier, R.: Fast Simplex Optimization for Active Appearance Model. In: Wada, T., Huang, F., Lin, S. (eds.) PSIVT 2009. LNCS, vol. 5414, pp. 106–117. Springer, Heidelberg (2009)
Kahraman, F., Gökmen, M.: Illumination Invariant Face Alignment Using Multi-band Active Appearance Model. In: Pal, S.K., Bandyopadhyay, S., Biswas, S. (eds.) PReMI 2005. LNCS, vol. 3776, pp. 118–127. Springer, Heidelberg (2005)
Le Gallou, S., Breton, G., Garcia, C., Séguier, R.: Distance maps: A robust illumination preprocessing for active appearance models. In: First International Conference on Computer Vision Theory and Applications, VISAPP 2006, vol. 02, pp. 35–40 (2006)
Kittipanya-ngam, P., Cootes, T.: The effect of texture representations on AAM performance. In: Proceedings of the 18th International Conference on Pattern Recognition, vol. 02, pp. 328–331 (2006)
Stegmann, M.B.: Master’s thesis, active appearance models: Theory, extensions and cases (2000)
Sung, J., Kim, D.: A background robust active appearance model using active contour technique. Pattern Recognition 40, 108–120 (2007)
Pham, M.T., Cham, T.J.: Fast training and selection of haar features using statistics in boosting-based face detection. In: IEEE 11th International Conference on Computer Vision, pp. 1–7 (2007)
Konak, A., Coit, D.W., Smith, A.E.: Multi-objective optimization using genetic algorithms: A tutorial. Reliability Engineering & System Safety 91, 992–1007 (2006)
Face recognition homepage (September 2011), http://www.face-rec.org/databases/ (last accessed November 13, 2011)
Ahlberg, J.: Real-time facial feature tracking using an active model with fast image warping. In: International Workshop on Very Low Bitrate Video, pp. 39–43 (2001)
A very fast bgra to grayscale conversion on iphone (February 2011), http://computer-vision-talks.com/ (last accessed October 27, 2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Quivy, CH., Kumazawa, I. (2012). “...It’s Orange and Small, and White Stripes...”. In: Lin, W., et al. Advances in Multimedia Information Processing – PCM 2012. PCM 2012. Lecture Notes in Computer Science, vol 7674. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34778-8_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-34778-8_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34777-1
Online ISBN: 978-3-642-34778-8
eBook Packages: Computer ScienceComputer Science (R0)