Skip to main content
SpringerLink
Log in

Multimodal workflow for the creation of interactive presentations of 360 spin images of historical violins

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The adoption of multimedia and multimodal applications inside museums and exhibitions is becoming a common practice. These installations proved to be particularly effective to attract visitors, especially the younger ones, and teach them complex information about the exposed artworks. A similar approach can be useful also to explain scientific analyses conducted on artworks, that commonly involve the use of complex analytical techniques, difficult to understand for inexpert people. In this work, we describe a multimodal workflow for the creation of interactive presentations of 360 spin images of historical violins. The workflow involves the acquisition, classification and visualization of the data. In particular, an ad hoc photographic set was built to achieve a fast acquisition of images both under visible and UV illumination, with the aim to study the surface of the instruments. Acquired images are classified and labeled using UVAnalyzer, an interactive application that supplies a set of tools for the analysis of UV fluorescence (UVF) images. Finally, KVN (Kinect Violin Navigator), a Kinect-based application, provides comfortable visualization and navigation within the data. During the development, we adopted a user-driven approach: user studies and suggestions from experts in UVF analysis were taken into account to improve the usability of the various steps of the workflow; then, a qualitative evaluation of the produced presentation was conducted on 22 volunteers. As a test set, we used images of violins exposed in the “Museo del Violino” in Cremona (Italy).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Bautista SS (2013) Museums in the digital age: changing meanings of place, community, and culture. AltaMira Press

  2. Bitossi G, Giorgi R, Mauro M, Salvadori B, Dei L (2005) Spectroscopic techniques in cultural heritage conservation: a survey. Appl Spectrosc Rev 40(3):187–228. https://doi.org/10.1081/ASR-200054370

    Article  Google Scholar 

  3. Blanchard EG, Zanciu AN, Mahmoud H, Molloy JS (2013) Enhancing in-museum informal learning by augmenting artworks with gesture interactions and aied paradigms. In: Lane HC, Yacef K, Mostow J, Pavlik P (eds) Artificial intelligence in education: 16th international conference, AIED 2013, Memphis, TN, USA, July 9-13, 2013. Proceedings. Springer, Berlin, pp 649–652, DOI https://doi.org/10.1007/978-3-642-39112-5_80, (to appear in print)

    Google Scholar 

  4. Brandmair B, Greiner PS (2010) Stradivari varnish: scientific analysis of his finishing technique on selected instruments. Serving audio

  5. Cantoni V, Lombardi L, Porta M, Setti A (2016) Interactive, tangible and multi-sensory technology for a cultural heritage exhibition: the battle of pavia. Springer International Publishing, Cham, pp 77–94

    Google Scholar 

  6. Chen Cc, Wactlar HD, Wang JZ, Kiernan K (2005) Digital imagery for significant cultural and historical materials. Int J Digit Libr 5(4):275–286. https://doi.org/10.1007/s00799-004-0097-5

    Article  Google Scholar 

  7. Cosentino A (2015) Practical notes on ultraviolet technical photography for art examination. Conservar Patrimnio, 53–62. https://doi.org/10.14568/cp2015006

    Article  Google Scholar 

  8. Din H, Wu S (2014) Digital heritage and culture: strategy and implementation, 1st edn. World Scientific Publishing Company

  9. Dondi P, Invernizzi C, Licchelli M, Lombardi L, Malagodi M, Rovetta T (2015) Semi-automatic system for UV images analysis of historical musical instruments. In: Proceedings of SPIE, optics for arts, architecture, and archaeology V, vol 9527, pp 95,270H–95,270H–9. https://doi.org/10.1117/12.2184744

  10. Dondi P, Lombardi L, Malagodi M, Licchelli M, Cacciatori F (2015) Color-based automatic detection of worn out varnishes on Stradivari’s “Scotland University” violin back plate. Color Res Appl p in press. https://doi.org/10.1002/col.22012

    Article  Google Scholar 

  11. Dondi P, Lombardi L, Malagodi M, Licchelli M, Rovetta T, Invernizzi C (2015) An interactive tool for speed up the analysis of UV images of Stradivari violins. In: New trends in image analysis and processing - ICIAP 2015 workshops, vol 9281, Springer International Publishing, Lecture Notes in Computer Science

    Chapter  Google Scholar 

  12. Dondi P, Lombardi L, Malagodi M, Licchelli M (2016) Automatic identification of varnish wear on historical instruments: the case of antonio stradivari violins. J Cult Heritage 22:968–973. https://doi.org/10.1016/j.culher.2016.05.010

    Article  Google Scholar 

  13. Dondi P, Lombardi L, Invernizzi C, Rovetta T, Malagodi M, Licchelli M (2017) Automatic analysis of uv-induced fluorescence imagery of historical violins. J Comput Cult Herit 10(2):12:1–12:13. https://doi.org/10.1145/3051472

    Article  Google Scholar 

  14. Dondi P, Lombardi L, Malagodi M, Licchelli M (2017) 3D modelling and measurements of historical violins. Acta IMEKO 6(3):29–34. https://doi.org/10.21014/acta_imeko.v6i3.455

    Article  Google Scholar 

  15. Fanini B, d’Annibale E, Demetrescu E, Ferdani D, Pagano A (2015) Engaging and shared gesture-based interaction for museums the case study of K2R international expo in rome. In: Proc. of 2015 digital heritage, vol 1, pp 263–270. https://doi.org/10.1109/DigitalHeritage.2015.7413880

  16. Han J, Shao L, Xu D, Shotton J (2013) Enhanced computer vision with microsoft kinect sensor: a review. IEEE Trans Cybern 43(5):1318–1334

    Article  Google Scholar 

  17. Hsieh CK, Liao WC, Yu MC, Hung YP (2014) Interacting with the past: creating a time perception journey experience using kinect-based breath detection and deterioration and recovery simulation technologies. J Comput Cult Herit 7(1):1:1–1:15. https://doi.org/10.1145/2535937

    Article  Google Scholar 

  18. Invernizzi C, Daveri A, Rovetta T, Vagnini M, Licchelli M, Cacciatori F, Malagodi M (2016) A multi-analytical non-invasive approach to violin materials: the case of Antonio Stradivari “Hellier” (1679). Microchem J 124:743–750. https://doi.org/10.1016/j.microc.2015.10.016

    Article  Google Scholar 

  19. Janssens K, Van Grieken R (2004) Non-destructive micro analysis of cultural heritage materials, vol 42. Elsevier, Amsterdam

    Google Scholar 

  20. Malagodi M, Canevari C, Bonizzoni L, Galli A, Maspero F, Martini M (2013) A multi-technique chemical characterization of a stradivari decorated violin top plate. Appl Phys A 112(2):225–234. https://doi.org/10.1007/s00339-013-7792-2

    Article  Google Scholar 

  21. Microsoft (2017) Meet kinect for windows. https://developer.microsoft.com/en-us/windows/kinect. Accessed 27 June 2017

  22. Mortara M, Catalano CE, Bellotti F, Fiucci G, Houry-Panchetti M, Petridis P (2014) Learning cultural heritage by serious games. J Cult Heritage 15(3):318–325. https://doi.org/10.1016/j.culher.2013.04.004

    Article  Google Scholar 

  23. New Media Consortium (2015) NMC Horizon Report (2015 Museum Edition). https://www.nmc.org/publication/nmc-horizon-report-2015-museum-edition/

  24. Nielsen J (1994) Usability engineering. Elsevier

  25. Paliokas I, Sylaiou S (2016) The use of serious games in museum visits and exhibitions: a systematic mapping study. In: 2016 8th International conference on games and virtual worlds for serious applications (VS-GAMES), pp 1–8. https://doi.org/10.1109/VS-GAMES.2016.7590371

  26. Pereira L (2010) Uv fluorescence photography of works of art: replacing the traditional uv cut filters with interference filters. Int J Conserv Sci 7(1):161–166. https://doi.org/10.1145/2535937

    Article  Google Scholar 

  27. Ramos E, Ramrez M, Nila E, Figueroa D, Hernndez J, Garca M, Prez E (2013) Based kinect application to promote mixtec culture. Procedia Technol 7:344–351. https://doi.org/10.1016/j.protcy.2013.04.043. 3rd Iberoamerican Conference on Electronics Engineering and Computer Science, CIIECC 2013

    Article  Google Scholar 

  28. Şen F, Díaz L, Horttana T (2012) A novel gesture-based interface for a VR simulation: re-discovering Vrouw Maria. In: 2012 18th International conference on virtual systems and multimedia, pp 323–330. https://doi.org/10.1109/VSMM.2012.6365941

  29. Simpson RS (2003) Lighting control: technology and applications. Taylor & Francis

  30. Soga A (2015) Virtual show, go in!: walk-through system and vr goggles of a temple for museum exhibits. In: Proc. of 2015 international conference on culture and computing (culture computing), pp 199–200. https://doi.org/10.1109/Culture.and.Computing.2015.25

  31. Stuart BH (2007) Analytical techniques in materials conservation. Wiley

  32. Styliani S, Fotis L, Kostas K, Petros P (2009) Virtual museums, a survey and some issues for consideration. J Cult Heritage 10(4):520–528. https://doi.org/10.1016/j.culher.2009.03.003

    Article  Google Scholar 

  33. Weede O, Muchinenyika SH, Muyingi HN (2014) Virtual welcome guide for interactive museums. In: Proc. of the 13th participatory design conference: short papers, industry cases, workshop descriptions, doctoral consortium papers, and keynote abstracts, PDC ’14, vol 2. ACM, New York, pp 167–169, https://doi.org/10.1145/2662155.2662222

  34. Yoshida R, Tamaki H, Sakai T, Nakadai T, Ogitsu T, Takemura H, Mizoguchi H, Namatame M, Saito M, Kusunoki F, Kamiyama S, Yamaguchi E, Inagaki S, Takeda Y, Sugimoto M, Egusa R (2015) Novel application of kinect sensor to support immersive learning within museum for children. In: Proc. of 2015 9th International conference on sensing technology (ICST), pp 834–837

  35. Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE MultiMedia 19(2):4–10. https://doi.org/10.1109/MMUL.2012.24

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank “Fondazione Museo del Violino Antonio Stradivari”, “Friends of Stradivari” and “Distretto Culturale di Cremona” for their collaboration.

Author information

Authors and Affiliations

  1. CISRiC - Arvedi Laboratory of Non-Invasive Diagnostics, University of Pavia, via Bell’Aspa 3, 26100, Cremona, Italy

    Piercarlo Dondi, Marco Malagodi & Maurizio Licchelli

  2. Department of Electrical, Computer and Biomedical Engineering, University of Pavia, via Ferrata 5, 27100, Pavia, Italy

    Luca Lombardi

  3. University of Pavia, Pavia, Italy

    Irene Rocca

  4. Department of Musicology and Cultural Heritage, University of Pavia, Corso Garibaldi 178, 26100, Cremona, Italy

    Marco Malagodi

  5. Department of Chemistry, University of Pavia, via Taramelli 12, 27100, Pavia, Italy

    Maurizio Licchelli

Authors
  1. Piercarlo Dondi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luca Lombardi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Irene Rocca
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marco Malagodi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maurizio Licchelli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Piercarlo Dondi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dondi, P., Lombardi, L., Rocca, I. et al. Multimodal workflow for the creation of interactive presentations of 360 spin images of historical violins. Multimed Tools Appl 77, 28309–28332 (2018). https://doi.org/10.1007/s11042-018-6046-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6046-x

Keywords

Search

Navigation