Skip to main content
SpringerLink
Log in

Experiencing the Multisensory Past

  • Chapter
  • First Online:
Mixed Reality and Gamification for Cultural Heritage

Abstract

The world is multisensory. All five major senses, visuals, audio, smell, feel and taste, are important to how we, humans, perceive the world around us. Furthermore, the interaction of the senses—cross-modal effects—can significantly affect our understanding of an environment, with one sensory stimuli even being ignored in the presence of other more dominant stimuli. This is as true now as it was in the past. So if we are to attempt, through computer simulation, to understand how a past environment may have been experienced, it is essential that these virtual reconstructions are multisensory, otherwise we run the very real risk of misrepresenting the past.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. P. Martinez, Digital Realities and Archaeology: A Difficult Relationship or a Fruitful Marriage? Proceedings of the 1st International Symposium on Virtual Reality, Archaeology, and Cultural Heritage VAST 2001, 9–16, 2001

    Google Scholar 

  2. P. Miller, J. Richards, The good, the bad and the downright misleading: archaeological adoption of computer visualization. Comput. Appl. Quant. Methods Archaeol. 19–22 (1994)

    Google Scholar 

  3. K. Devlin, A.G. Chalmers, in Realistic Visualisation of the Pompeii Frescoes. AFRIGRAPH 2001 (ACM SIGGRAPH Publications, 2001), pp. 43–48

    Google Scholar 

  4. A. Gonçalves, L. Magalhães, J. Moura, A. Chalmers, Accurate Modelling of Roman Lamps in Conimbriga Using High Dynamic Range. VAST’08: Proceedings of the Symposium on Virtual Reality, Archaeology and Cultural Heritage, 2008

    Google Scholar 

  5. L. Itti, C. Koch, A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res. 40(10–12), 1489–1506 (2000)

    Google Scholar 

  6. A.L. Yarbus, Eye movements during perception of complex objects, Chapter VII, in Eye Movements and Vision, ed. by L.A. Riggs (Plenum Press, New York, NY, 1967), pp. 171–196

    Chapter  Google Scholar 

  7. B. Leonard, L. Martin, in Literature Review on Skill Fade. Human Factors Integration Defence Technology Centre/2/WP10.3/2, Version No. 1/25, May 2007

    Google Scholar 

  8. S. Marsland, U. Nehmzow, J. Shapiro, Novelty Detection on a Mobile Robot Using Habituation. From Animals to Animats: The 6th International Conference on Simulation of Adaptive Behaviour, 2000

    Google Scholar 

  9. A. Mack, I. Rock, in Inattentional Blindness. Proceedings of Symposium on Interactive 3D Graphics, Massachusetts Institute of Technology Press, 1998

    Google Scholar 

  10. D. Nunez, E.H. Blake, in Conceptual Priming as a Determinant of Presence in Virtual Environments. Afrigraph 2003, ACM SIGGRAPH, pp. 101–108, 2003

    Google Scholar 

  11. A.G. Chalmers, D. Howard, C. Moir, in Real Virtuality: A Step Change from Virtual Reality. SCCG’09 (ACM Press, 2009)

    Google Scholar 

  12. G. Calvert, C. Spence, B. Stein, The Multisensory Handbook (MIT Press, Cambridge, MA, 2004)

    Google Scholar 

  13. B. Stein, M. Meredith, The Merging of the Senses (MIT Press, Cambridge, MA, 1993)

    Google Scholar 

  14. T.G. Giolas, E.C. Butterfield, S.J. Weaver, Some motivational correlates of lipreading. J. Speech Hear. Res. 17, 18–24 (1974)

    Article  Google Scholar 

  15. K. Sekiyama, Y.J. Tohkura, McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Acoust. Soc. Am. 90, 1797–1805 (1991)

    Article  Google Scholar 

  16. J. Irwin, D. Whalen, A sex difference in visual influence on heard speech. Percept. Psychophys. 68(4), 582–592 (2006)

    Article  Google Scholar 

  17. A. Alsius, J. Navarra, R. Campbell, S. Soto-Faraco, Audiovisual integration of speech falters under high attention demands. Curr. Biol. 15(839–843) (2005)

    Google Scholar 

  18. J. Townsend, M. Adamo, F. Haist, Changing channels: an fMRI study of aging and cross-modal attention shifts. NeuroImage 31(4), 1682–1692 (2006)

    Article  Google Scholar 

  19. M.O. Ernst, H.H. Bülthoff, Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162–169 (2004)

    Article  Google Scholar 

  20. T.S. Andersen, K. Tiipanna, M. Sams, Factors influencing audiovisual fission and fusion illusions. Cogn. Brain Res. 21, 301–308 (2004)

    Article  Google Scholar 

  21. A.G. Chalmers, A. Ferko, in Levels of Realism: from Virtual Reality to Real Virtuality. In SCCG'08: Spring Conference on Computer Graphics, ACM SIGGRAPH Press, pp. 27–33, 2008

    Google Scholar 

  22. J. Ferwerda, in Three Varieties of Realism in Computer Graphics. Proceedings SPIE Human Vision and Electronic Imaging, pp. 290–297, 2003

    Google Scholar 

  23. F. Banterle, A. Artusi, K. Debattista, A.G Chalmers, Advanced High Dynamic Range Imaging. (CRC Press, Boca Raton, 2011). ISBN: 978-156881-719-4

    Google Scholar 

  24. H. Seetzen, W. Heidrich, W. Stuerzlinger, G. Ward, L. Whitehead, M. Trentacoste, A. Ghosh, A. Vorozcovs, High dynamic range display systems. ACM Trans. Graphics 23(3) (2004)

    Google Scholar 

  25. SIM2 HDR 47 Engineering display series, http://hdr.sim2.it/. Feb 2017

  26. V. Hulusic, C. Harvey, K. Debattista, N. Tsingos, S. Walker, D. Howard, A.G. Chalmers, Acoustic rendering and auditory-visual cross-modal perception and interaction. Comput. Graphics Forum 31(1), 102–131 (2012)

    Article  Google Scholar 

  27. N. Tsingos, E. Gallo, G. Drettakis, in Perceptual Audio Rendering of Complex Virtual Environments. SIGGRAPH 2004 (ACM Press, 2004), pp. 249–258

    Google Scholar 

  28. V. Hulusíc, C. Harvey, K. Debattista, N. Tsingos, S. Walker, D. Howard, A.G. Chalmers, Acoustic rendering and auditory-visual cross-modal perception and interaction. Comput. Graphics Forum 31(1), 102–131 (2012)

    Google Scholar 

  29. A. Saddik, The potential of haptic technologies. IEEE Instrum. Meas. Mag. 10(31), 10–17 (2007)

    Article  Google Scholar 

  30. K.A. Robson Brown, A.G. Chalmers, T. Saigol, C. Green, F. d’Errico, An automated laser scan survey of the Upper Palaeolithic rock shelter of Cap Blanc. J. Archaeol. Sci. 28, 283–289 (2001)

    Article  Google Scholar 

  31. E. Zányi, Y. Chrysanthou, J. Happa, V. Hulusic, A.G. Chalmers, in The High-Fidelity Computer Reconstruction of Byzantine Art. Cyprus IV International Congress of Cypriot Studies, April 2008

    Google Scholar 

  32. Jorvik Viking Centre, http://jorvik-viking-centre.co.uk/contact-us/press/forget-3d-discover-vikings-in-4d-this-summer/. Jul 2015

  33. J. Aggleton, L. Waskett, The ability of odours to serve as state-dependent cues for real-world memories: can Viking smells aid the recall of Viking experiences? Br. J. Psychol. 90, 1–7 (1999)

    Article  Google Scholar 

  34. H. Abdi, What can cognitive psychology and sensory evaluation learn from each other? Food Qual. Prefer. 13, 445–451 (2002)

    Article  Google Scholar 

  35. C.M. Delahunty, J.R. Piggott, Current methods to evaluate contribution and interactions of components to flavour of solid foods using hard cheese as an example. Int. J. Food Sci. Technol. 30, 555–570 (1995)

    Article  Google Scholar 

  36. E.T. Rolls, Taste, olfactory, and food reward value processing in the brain. Prog. Neurobiol. 127–128, 64–90 (2015). doi:10.1016/j.pneurobio.2015.03.002

    Article  Google Scholar 

  37. J. Verhagen, L. Engelen, The neurocognitive bases of human multimodal food perception: sensory integration. Neurosci. Biobehav. Rev. 30, 613–650 (2006)

    Article  Google Scholar 

  38. H. Iwata, H. Yano, T. Uemura, T. Moriya, Food Simulator. ICAT’03: Proceedings of the 13th International Conference on Artificial Reality and Telexistence (IEEE Press, 2003)

    Google Scholar 

  39. N. Ranasinghe, A. Cheok, R. Nakatsu, E. Yi-Luen Do, in Simulating the Sensation of Taste for Immersive Experiences. ImmersiveMe ’13 (ACM Multimedia, 2013)

    Google Scholar 

  40. T. Narumi, M. Sato, T. Tanikawa, M. Hirose, in Evaluating Cross-Sensory Perception of Superimposing Virtual Color onto Real Drink: Toward Realization of Pseudo-gustatory Displays. 1st Augmented Human Interaction Conference (ACM, 2010)

    Google Scholar 

  41. T. Narumi, S. Nishizaka, T. Kajinami, T. Tanikawa, M. Hirose, in MetaCookie+. Virtual Reality Conference (IEEE, 2011)

    Google Scholar 

  42. G. Wright, Kalabsha: The Preserving of the Temple (Gebr. Mann Verlag, Berlin, 1972)

    Google Scholar 

  43. S. Quirke, The Cult of RA: Sun Worship in Ancient Egypt (Thames and Hudson Distributors LTD, New York, NY, 2001)

    Google Scholar 

  44. F. Kahnert, Reproducing the optical properties of fine desert dust aerosols using ensembles of simple model particles. J. Quant. Spectrosc. Radiat. Transfer 85, 231–249 (2003)

    Article  Google Scholar 

  45. V. Sundstedt, D. Gutierrez, F. Gomez, A. Chalmers, in Participating Media for High-Fidelity Cultural Heritage. Proceedings of the Conference on Virtual Reality, Archaeology and Cultural Heritage. Eurographics (VAST’05), 2005

    Google Scholar 

  46. D.H. Brown, A.G. Chalmers, A. McNamara, in Light and the Culture of Colour in Medieval Pottery. The International Conference of Medieval and Later Archaeology, Brugge, October 1997

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. WMG, University of Warwick, Coventry, UK

    Alan Chalmers

Authors
  1. Alan Chalmers
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alan Chalmers .

Editor information

Editors and Affiliations

  1. Digital Heritage Research, Cyprus University of Technology Digital Heritage Research, Limassol, Cyprus

    Marinos Ioannides

  2. University of Geneva , Carouge, Switzerland

    Nadia Magnenat-Thalmann

  3. Department of Computer Science, University of Crete & FORTH Department of Computer Science, Heraklion, Greece

    George Papagiannakis

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Chalmers, A. (2017). Experiencing the Multisensory Past. In: Ioannides, M., Magnenat-Thalmann, N., Papagiannakis, G. (eds) Mixed Reality and Gamification for Cultural Heritage. Springer, Cham. https://doi.org/10.1007/978-3-319-49607-8_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49607-8_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49606-1

  • Online ISBN: 978-3-319-49607-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation