Skip to main content
SpringerLink
Log in

Sensory Experience: Quality of Experience Beyond Audio-Visual

  • Chapter
  • First Online:
Book cover Quality of Experience

Part of the book series: T-Labs Series in Telecommunication Services ((TLABS))

Abstract

This chapter introduces the concept of Sensory Experience which aims to define the Quality of Experience (QoE) going beyond audio-visual content. In particular, we show how to utilize sensory effects such as ambient light, scent, wind, or vibration as additional dimensions contributing to the quality of the user experience. Therefore, we utilize a standardized representation format for sensory effects that are attached to traditional multimedia resources such as audio, video, and image contents. Sensory effects are rendered on special devices (e.g., fans, lights, motion chair, scent emitter) in synchronization with the traditional multimedia resources and shall stimulate also other senses than hearing and seeing with the intention to increase the Quality of Experience (QoE), in this context referred to as Sensory Experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ademoye O, Ghinea G (2009) Synchronization of olfaction-enhanced multimedia. IEEE Trans Multimedia 11(3):561–565. doi:10.1109/TMM.2009.2012927

    Article  Google Scholar 

  2. Bjontegaard G (2001) Calculation of average PSNR differences between RD curves. ITU-T VCEG meeting VCEG-M33, Austin, USA

    Google Scholar 

  3. Cherif W, Ksentini A, Negru D, Sidibe M (2011) \({\rm {A}}{\_}{\rm {PSQA}}\): efficient real-time video streaming QoE tool in a future media internet context. In: IEEE international conference on multimedia and expo (ICME 2001), pp 1–6. doi:10.1109/ICME.2011.6011993

  4. Eid M, Cha J, El-Saddik A (2011) Admux: an adaptive multiplexer for haptic audio-visual-data communication. IEEE Trans Instrum Meas 60(1):21–31. doi:10.1109/TIM.2010.2065530

    Article  Google Scholar 

  5. Fiedler M, Hoßfeld T, Tran-Gia P (2010) A generic quantitative relationship between quality of experience and quality of service. IEEE Network (special issue on improving QoE for network services)

    Google Scholar 

  6. Ghinea G, Ademoye O (2010) A user perspective of olfaction-enhanced MulSeMedia. In: Proceedings of the international conference on management of emergent digital ecosystems (MEDES ’10). ACM, New York, pp 277–280. doi:10.1145/1936254.1936308. http://doi.acm.org/10.1145/1936254.1936308

  7. Ghinea G, Ademoye O (2010) Perceived synchronization of olfactory multimedia. IEEE Trans Syst Man Cybern Part A Syst Hum 40(4):657–663. doi:10.1109/TSMCA.2010.2041224

    Article  Google Scholar 

  8. Hoshino S, Ishibashi Y, Fukushima N, Sugawara S (2011) QoE assessment in olfactory and haptic media transmission: influence of inter-stream synchronization error. In: IEEE international workshop technical committee on communications quality and reliability (CQR 2011), pp 1–6. doi:10.1109/CQR.2011.5996082

  9. ISO/IEC 23005–3 (2010) Information technology—media context and control—sensory information. ISO/IEC JTC 1/SC 29/WG 11/N11425, Geneva, Switzerland

    Google Scholar 

  10. ITU-R Rec. BT.500-13 (2012) Methodology for the subjective assessment of the quality of television pictures

    Google Scholar 

  11. ITU-T Rec. P.910 (2008) Subjective video quality assessment methods for multimedia applications

    Google Scholar 

  12. ITU-T Rec. P.911 (2008) Subjective audiovisual quality assessment methods for multimedia applications

    Google Scholar 

  13. Möller S, Le Callet P, Perkis A (eds) Qualinet white paper on definitions of quality of experience—output version of the Dagstuhl seminar 12181: European network on quality of experience in multimedia systems and services (COST Action IC 1003), Lausanne, 1.1 edn

    Google Scholar 

  14. Murray N, Qiao Y, Lee B, Karunakar AK, Muntean GM (2013) Age and gender influence on perceived olfactory and visual media synchronization. In: 2013 IEEE international conference on multimedia and expo (ICME ’13). IEEE, p 16. doi:10.1109/ICME.2013.6607467

  15. Murray N, Qiao Y, Lee B, Karunakar AK, Muntean GM (2013) Subjective evaluation of olfactory and visual media synchronization. In: Proceedings of the 4th ACM multimedia systems conference (MMSys ’13). ACM, New York, pp 162–171. doi:10.1145/2483977.2483999. http://doi.acm.org/10.1145/2483977.2483999

  16. Murray N, Qiao Y, Lee B, Karunakar AK, Muntean GM (2014) User profile based perceived olfactory and visual media synchronization. ACM Trans Multimedia Comput Commun Appl 1(10)

    Google Scholar 

  17. Nakamoto T, Yoshikawa K (2006) Movie with scents generated by olfactory display using solenoid valves. In: Virtual reality conference 2006, pp 291–292. doi:10.1109/VR.2006.102

  18. Pereira F (2005) A triple user characterization model for video adaptation and quality of experience evaluation. In: IEEE 7th workshop on multimedia signal processing 2005, pp 1–4. doi:10.1109/MMSP.2005.248674

  19. Pyo S, Joo S, Choi B, Kim M, Kim J (2008) A metadata schema design on representation of sensory effect information for sensible media and its service framework using UPnP. In: 10th international conference on advanced communication technology (ICACT 2008), vol 2, pp 1129–1134. doi:10.1109/ICACT.2008.4493965

  20. de Ruyter B, Aarts E (2004) Ambient intelligence: visualizing the future. In: Proceedings of the working conference on advanced visual interfaces (AVI ’04). ACM Press, New York, pp 203–208. doi:10.1145/989863.989897 http://dx.doi.org/10.1145/989863.989897

  21. Seuntiens P, Vogels I, van Keersop A (2007) Visual experience of 3D-TV with pixelated ambilight. In: Proceeding of the 10th annual international workshop on presence, pp 339–344

    Google Scholar 

  22. Steinmetz R (1996) Human perception of jitter and media synchronization. IEEE J Sel Areas Commun 14(1):61–72. doi:10.1109/49.481694

    Article  Google Scholar 

  23. Storms RL, Zyda MJ (2000) Interactions in perceived quality of auditory-visual displays. Presence: Teleoper Virtual Environ 9(6):557–580. doi:10.1162/105474600300040385. http://dx.doi.org/10.1162/105474600300040385

  24. Sugimoto S, Noguchi D, Bannnai Y, Okada K (2010) Ink jet olfactory display enabling instantaneous switches of scents. In: Proceedings of the international conference on Multimedia (MM ’10). ACM, New York, pp 301–310. doi:10.1145/1873951.1873994. http://doi.acm.org/10.1145/1873951.1873994

  25. Timmerer C, Rainer B, Waltl M (2013) A utility model for sensory experience. In: Proceedings of the fifth international workshop on quality of multimedia experience (QoMEX 2013). IEEE, Los Alamitos, CA

    Google Scholar 

  26. Waltl M, Timmerer C, Hellwagner H (2009) A test-bed for quality of multimedia experience evaluation of sensory effects. In: Ebrahim T, El-Maleh K, Dane G, Karam L (eds) Proceedings of the first international workshop on quality of multimedia experience (QoMEX 2009). IEEE, Los Alamitos, CA, pp 145–150. doi:10.1109/QOMEX.2009.5246962. http://www.qomex2009.org

  27. Waltl M, Timmerer C, Hellwagner H (2010) Improving the quality of multimedia experience through sensory effects. In: Perkis A, Mller S, Svensson P, Reibman A (eds) Proceedings of the 2nd international workshop on quality of multimedia experience (QoMEX’10). IEEE, Trondheim, Norway, pp 124–129. http://www.qomex2010.org

  28. Waltl M, Timmerer C, Hellwagner H (2010) Increasing the user experience of multimedia presentations with sensory effects. In: Leonardi R, Migliorati P, Cavallaro A (eds) Proceedings of the 11th international workshop on image analysis for multimedia interactive services (WIAMIS’10). IEEE, Desenzano del Garda, pp 1–4

    Google Scholar 

  29. Waltl M, Timmerer C, Rainer B, Hellwagner H (2012) Sensory effect dataset and test setups. In: 2012 Fourth international workshop on quality of multimedia experience (QoMEX 2012), pp 115–120. doi:10.1109/QoMEX.2012.6263841

  30. Wang T, Pervez A, Zou H (2010) VQM-based QoS/QoE mapping for streaming video. In: 3rd IEEE international conference on broadband network and multimedia technology (IC-BNMT 2010), pp 807–812. doi:10.1109/ICBNMT.2010.5705202

  31. Yoon K, Choi B, Lee ES, Lim TB (2010) 4-d broadcasting with mpeg-v. In: IEEE international workshop on multimedia signal processing (MMSP 2010), pp 257–262. doi:10.1109/MMSP.2010.5662029

  32. Zinner T, Hohlfeld O, Abboud O, Hoßfeld T (2010) Impact of frame rate and resolution on objective QoE metrics. In: International workshop on quality of multimedia experience 2010, Trondheim

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Alpen-Adria-Universitaet Klagenfurt, Klagenfurt, Austria

    Christian Timmerer, Markus Waltl & Benjamin Rainer

  2. Athlone Institute of Technology, Dublin, Ireland

    Niall Murray

Authors
  1. Christian Timmerer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Markus Waltl
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Benjamin Rainer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Niall Murray
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christian Timmerer .

Editor information

Editors and Affiliations

  1. Quality and Usability Lab Telekom Innovation Laboratories, TU Berlin, Berlin, Germany

    Sebastian Möller

  2. Assessment of IP-based Applications Telekom Innovation Laboratories, TU Berlin, Berlin, Germany

    Alexander Raake

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Timmerer, C., Waltl, M., Rainer, B., Murray, N. (2014). Sensory Experience: Quality of Experience Beyond Audio-Visual. In: Möller, S., Raake, A. (eds) Quality of Experience. T-Labs Series in Telecommunication Services. Springer, Cham. https://doi.org/10.1007/978-3-319-02681-7_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02681-7_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02680-0

  • Online ISBN: 978-3-319-02681-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation