Abstract
Imaging Novecento is a native mobile application that can be used to get insights on artworks in the “Museo Novecento” in Florence, IT. The App provides smart paradigms of interaction to ease the learning of the Italian art history of the 20\(^{th}\) century. Imaging Novecento exploits automatic approaches and gamification techniques with recreational and educational purposes. Its main goal is to reduce the cognitive effort of users versus the complexity and the numerosity of artworks present in the museum. To achieve this the App provides automatic artwork recognition. It also uses gaming, in terms of a playful user interface which features state-of-the-art algorithms for artistic style transfer. Automated processes are exploited as a mean to attract visitors, approaching them to even lesser known aspects of the history of art.
This is a preview of subscription content, log in via an institution to check access.
Notes
- 1.
- 2.
The network is available online at http://caffe.berkeleyvision.org/gathered/examples/finetune_flickr_style.html.
- 3.
References
Anderson, A.G., Berg, C.P., Mossing, D.P., Olshausen, B.A.: Deepmovie: using optical flow and deep neural networks to stylize movies. arXiv preprint arXiv:1605.08153 (2016)
Anwer, R.M., Khan, F.S., van de Weijer, J., Laaksonen, J.: Combining holistic and part-based deep representations for computational painting categorization. In: Proceedings of the 2016 ACM ICMR, pp. 339–342. ACM (2016)
Ballagas, R., Rohs, M., Sheridan, J.G., Borchers, J.: Byod: bring your own device. In: Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, vol. 2004 (2004)
Baraldi, L., Paci, F., Serra, G., Benini, L., Cucchiara, R.: Gesture recognition using wearable vision sensors to enhance visitors Museum experiences. IEEE Sens. J. 15(5), 2705–2714 (2015)
Chen, C.Y., Chang, B.R., Huang, P.S.: Multimedia augmented reality information system for Museum guidance. Pers. Ubiquit. Comput. 18(2), 315–322 (2014)
Crowley, E., Zisserman, A.: The state of the art: object retrieval in paintings using discriminative regions. In: BMVC (2014)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM (2001)
Elgammal, A., Lee, C.S.: Separating style and content on a nonlinear manifold. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, pp. I–478. IEEE (2004)
Fanini, B., d’Annibale, E., Demetrescu, E., Ferdani, D., Pagano, A.: Engaging and shared gesture-based interaction for museums the case study of K2R international expo in rome. In: 2015 Digital Heritage, vol. 1, pp. 263–270. IEEE (2015)
Fineschi, A., Pozzebon, A.: A 3D virtual tour of the Santa Maria della Scala Museum Complex in Siena, Italy, based on the use of Oculus RIFT HMD. In: 2015 International Conference on 3D Imaging (IC3D), pp. 1–5. IEEE (2015)
Gatys, L.A., Ecker, A.S., Bethge, M.: A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 (2015)
He, Z., Cui, B., Zhou, W., Yokoi, S.: A proposal of interaction system between visitor and collection in Museum hall by iBeacon. In: 2015 10th International Conference on Computer Science & Education (ICCSE), pp. 427–430. IEEE (2015)
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM MM, pp. 675–678. ACM (2014)
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. arXiv preprint arXiv:1603.08155 (2016)
Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: The NMC Horizon Report: 2015 Museum Edition. ERIC (2015)
Karayev, S., Trentacoste, M., Han, H., Agarwala, A., Darrell, T., Hertzmann, A., Winnemoeller, H.: Recognizing image style. arXiv preprint arXiv:1311.3715 (2013)
Kyprianidis, J.E., Collomosse, J., Wang, T., Isenberg, T.: State of the “Art”: a taxonomy of artistic stylization techniques for images and video. IEEE Trans. Vis. Comput. Graph. 19(5), 866–885 (2013)
Malomo, L., Banterle, F., Pingi, P., Gabellone, F., Scopigno, R.: Virtualtour: a system for exploring cultural heritage sites in an immersive way. In: 2015 Digital Heritage, vol. 1, pp. 309–312. IEEE (2015)
Mayer, R.E., Moreno, R.: Nine ways to reduce cognitive load in multimedia learning. Educ. Psychol. 38(1), 43–52 (2003)
Negruşa, A.L., Toader, V., Sofică, A., Tutunea, M.F., Rus, R.V.: Exploring gamification techniques and applications for sustainable tourism. Sustainability 7(8), 11160–11189 (2015)
Pagano, A., Armone, G., De Sanctis, E.: Virtual Museums and audience studies: the case of “Keys to Rome” exhibition. In: 2015 Digital Heritage, vol. 1, pp. 373–376. IEEE (2015)
Park, S.: The effects of social cue principles on cognitive load, situational interest, motivation, and achievement in pedagogical agent multimedia learning. J. Educ. Technol. Soc. 4, 211–229 (2015)
Peng, K.C., Chen, T.: Cross-layer features in convolutional neural networks for generic classification tasks. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3057–3061. IEEE (2015)
Reiners, T., Wood, L.C. (eds.): Gamification in Education and Business. Springer International Publishing, Switzerland (2015)
Ruf, B., Kokiopoulou, E., Detyniecki, M.: Mobile Museum guide based on fast SIFT recognition. In: Detyniecki, M., Leiner, U., Nürnberger, A. (eds.) AMR 2008. LNCS, vol. 5811, pp. 170–183. Springer, Heidelberg (2010). doi:10.1007/978-3-642-14758-6_14
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
de Sousa Borges, S., Durelli, V.H., Reis, H.M., Isotani, S.: A systematic mapping on gamification applied to education. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, pp. 216–222. ACM (2014)
Temmermans, F., Jansen, B., Deklerck, R., Schelkens, P., Cornelis, J.: The mobile Museum guide: artwork recognition with eigenpaintings and SURF. In: WIAMIS 2011, Delft, The Netherlands, April 13–15, 2011. TU Delft; EWI; MM; PRB (2011)
Tenenbaum, J.B., Freeman, W.T.: Separating style and content with bilinear models. Neural Comput. 12(6), 1247–1283 (2000)
Xie, X., Tian, F., Seah, H.S.: Feature guided texture synthesis (FGTS) for artistic style transfer. In: Proceedings of the 2nd International Conference on Digital Interactive Media in Entertainment and Arts, pp. 44–49. ACM (2007)
Yoon, S.A., Wang, J.: Making the invisible visible in science museums through augmented reality devices. TechTrends 58(1), 49–55 (2014)
Acknowledgments
We acknowledge the support of the “Museo Novecento” in Florence, IT, and the Municipality of Florence, IT. This research was supported by “THE SOCIAL MUSEUM AND SMART TOURISM”, MIUR project no. CTN01_00034_23154_SMST.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Becattini, F., Ferracani, A., Landucci, L., Pezzatini, D., Uricchio, T., Del Bimbo, A. (2016). Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles. In: Ioannides, M., et al. Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection. EuroMed 2016. Lecture Notes in Computer Science(), vol 10058. Springer, Cham. https://doi.org/10.1007/978-3-319-48496-9_62
Download citation
DOI: https://doi.org/10.1007/978-3-319-48496-9_62
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48495-2
Online ISBN: 978-3-319-48496-9
eBook Packages: Computer ScienceComputer Science (R0)