Abstract
MNEMOSYNE is a three year project whose primary goal is to deliver a personalized, interactive multimedia experience to museum visitors through the novel application of personalization driven by computer vision-based profiling. A combination of passive, wall-mounted cameras and sensors carried by guests acquiring active and passive imagery will be used to create a general profile of a museum visitor’s interests in order to customize the presentation at interactive tabletop surfaces placed in the museum environment. In this article we discuss the general context in which MNEMOSYNE is defined, as well as the main technical directions the project will follow over the next three years. Some very preliminary results are given for the vision-based techniques to be used for visual profiling of museum visitors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering 17 (2005)
Badri, J., Tilmant, C., Lavest, J.-M., Pham, Q.-C., Sayd, P.: Camera-to-Camera Mapping for Hybrid Pan-Tilt-Zoom Sensors Calibration. In: Ersbøll, B.K., Pedersen, K.S. (eds.) SCIA 2007. LNCS, vol. 4522, pp. 132–141. Springer, Heidelberg (2007)
Bagdanov, A.D., Dini, F., Del Bimbo, A., Nunziati, W.: Improving the robustness of particle filter-based visual trackers using online parameter adaptation. In: Proc. of IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS). IEEE Computer Society, London (2007), http://www.micc.unifi.it/publications/2007/BDDN07a
Ballan, L., Bertini, M., Del Bimbo, A., Seidenari, L., Serra, G.: Effective codebooks for human action categorization. In: Proc. of ICCV Int’l Workshop on Video-oriented Object and Event Classification (VOEC), Kyoto, Japan (September 2009), http://www.micc.unifi.it/publications/2009/BBDSS09a
Baraldi, S., Bimbo, A.D., Landucci, L.: Natural interaction on the tabletop. Multimedia Tools and Applications (2008)
Baraldi, S., Bimbo, A.D., Landucci, L., Torpei, N.: Entry: Natural interaction. In: Szsu, M.T., Liu, L. (eds.) Encyclopedia of Database Systems. Springer, Heidelberg (2008)
Bimbo, A.D., Dini, F., Lisanti, G., Pernici, F.: Exploiting distinctive visual landmark maps in pan-tilt-zoom camera networks. Computer Vision and Image Understanding 114(6), 611–623 (2010), special Issue on Multi-Camera and Multi-Modal Sensor Fusion
Bowen, J., Filippini-Fantoni, S.: Personalization and the web from a museum perspective. In: Proceedings of the 2004 Museums and the Web Conference (2004)
Brusilovsky, P., Maybury, M.T.: From adaptive hypermedia to the adaptive web. Communications of the ACMÂ 45(5) (2002)
Criminisi, A., Reid, I., Zisserman, A.: Single view metrology. International Journal of Computer Vision 40(2), 123–148 (2000)
Del Bimbo, A., Dini, F., Grifoni, A., Pernici, F.: Pan-tilt-zoom camera networks. In: Aghajan, H., Cavallaro, A. (eds.) Multi-Camera Networks: Principles and Applications, Academic Press (2009)
Del Bimbo, A., Dini, F., Lisanti, G.: A real time solution for face logging. In: Proc. of International Conference on Imaging for Crime Detection and Prevention, ICDP (2009), http://www.micc.unifi.it/publications/2009/DDL09
Fikkert, F.W., Hakvoort, M., van der Vet, P.E., Nijholt, A.: Experiences with interactive multi-touch tables. In: Proceedings of INTETAIN (2009)
Horaud, R., Knossow, D., Michaelis, M.: Camera cooperation for achieving visual attention. Mach. Vis. Appl. 16(6), 1–2 (2006)
Jain, A., Kopell, D., Kakligian, K., Wang, Y.F.: Using stationary-dynamic camera assemblies for wide-area video surveillance and selective attention. In: CVPR 2006: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 537–544. IEEE Computer Society, Washington, DC, USA (2006)
Norman, D.: The Invisible Computer. The MIT Press (1998)
Pechenizkiy, M., Calders, T.: A framework for guiding the museum tour personalization. In: Proceedings of PEACH 2007 (2007)
Rocchi, C., Stock, O., Zancanaro, M., Kruppa, M., Kruger, A.: The museum visit: Generating seamless personalized presentations on multiple devices. In: Proceedings of the 2004 Conference on Intelligent User Interfaces (2004)
Senior, A., Hampapur, A., Lu, M.: Acquiring multi-scale images by pan-tilt-zoom control and automatic multi-camera calibration. In: IEEE Workshop on Applications on Computer Vision (2005)
Sparacino, F.: The museum wearable: real-time sensor-driven understanding of visitors’ interests for personalized visually-augmented museum experiences. In: Proceedings of Museums and the Web, MW 2002 (2002)
Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., Pentland, A.: Augmented reality through wearable computing. Presence 6(4) (1997)
Turk, M., Robertson, G.: Perceptual user interfaces. Communications of the ACM (2000)
Van Gool, L., Proesmans, M., Zisserman, A.: Grouping and invariants using planar homologies. In: Workshop on Geometrical Modeling and Invariants for Computer Vision. Xidian University Press (1995)
Wang, Y., Aroyo, L., Stash, N., Sambeek, R., Schuurmans, Y., Schreiber, G., Gorgels, P.: Cultivating personalized museum tours online and on-site. Interdisciplinary Science Reviews 34(2) (2009)
Zhou, X., Collins, R., Kanade, T., Metes, P.: A master-slave system to acquire biometric imagery of humans at a distance. In: ACM SIGMM 2003 Workshop on Video Surveillance, pp. 113–120 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bagdanov, A.D., Del Bimbo, A., Landucci, L., Pernici, F. (2012). MNEMOSYNE: Enhancing the Museum Experience through Interactive Media and Visual Profiling. In: Grana, C., Cucchiara, R. (eds) Multimedia for Cultural Heritage. MM4CH 2011. Communications in Computer and Information Science, vol 247. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27978-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-27978-2_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27977-5
Online ISBN: 978-3-642-27978-2
eBook Packages: Computer ScienceComputer Science (R0)