Skip to main content
Log in

Sensory effects for ambient experiences in the World Wide Web

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

More and more content in various formats becomes available via the World Wide Web (WWW). Currently available Web browsers are able to access and interpret these contents (i.e., Web videos, text, image, and audio). These contents stimulate only senses like audition or vision. Recently, it has been proposed to stimulate also other senses while consuming multimedia content, through so-called sensory effects. These sensory effects aim to enhance the ambient experience by providing effects such as light, wind, vibration, etc. The effects are represented as Sensory Effect Metadata (SEM) description which is associated to multimedia content and is rendered on devices like fans, vibration chairs, or lamps. In this paper we present two subjective quality assessments which comprise sensory effects, such as light, in the area of the WWW and their results achieved. The first assessment evaluates the influence of light effects on the Quality of Experience (QoE). The second assessment measures the impact of different settings for the color calculation on the viewing experience. Furthermore, we describe a Web browser plug-in for Mozilla Firefox which is able to render such sensory effects that are provided via the WWW.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Aarts EHL (2004) Ambient intelligence: a multimedia perspective. IEEE Multimedia 11(1):12–19

    Article  Google Scholar 

  2. amBX UK Ltd (2011) amBX website. http://www.ambx.com. Accessed 16 Nov 2011

  3. Begemann SHA (2005) A scientific study on the effects of ambilight in flat-panel displays. http://bit.ly/pxbZYA. Accessed 23 Jan 2012

  4. Choi BS, Joo SH, Lee HY (2009) Sensory effect metadata for SMMD media service. In: Fourth International Conference on Internet and Web applications and services (ICIW 2009). Venice/Mestre, Italy, pp 649–654

  5. Gecko SDK (2011) Gecko SDK website. https://developer.mozilla.org/en/Gecko_SDK. Accessed 16 Nov 2011

  6. Ghinea G, Ademoye OA (2009) Olfaction-enhanced multimedia: bad for information recall? In: IEEE International Conference on Multimedia and Expo 2009 (ICME 2009). New York, USA, pp 970–973

  7. Hickson I (2010) HTML5, Working draft. W3C. http://www.w3.org/TR/2010/WD-html5-20100624/. Accessed 23 Jan 2012

  8. ISO/IEC 23005 (2011) MPEG-V: information technology—media context and control

  9. ISO/IEC 23005-3 (2011) MPEG-V: information technology—media context and control—part 3: sensory information

  10. ITU-R Rec. BT.500-11 (2002) Methodology for the subjective assessment of the quality of television pictures

  11. ITU-T Rec. P.910 (2008) Subjective video quality assessment methods for multimedia applications

  12. ITU-T Rec. P.911 (1998) Subjective audiovisual quality assessment methods for multimedia applications

  13. Schmidt A, Gellersen H, Beigl M (1999) Matching information and ambient media. In: Streitz NA, Siegel J, Hartkopf V, Konomi S (eds) Proceedings of the second international workshop on cooperative buildings, integrating information, organization, and architecture. Lecture notes in computer science, vol 1670. Springer-Verlag, London, pp 140–149

    Chapter  Google Scholar 

  14. Seuntiens P, Vogels I, van Keersop A (2007) Visual experience of 3D-TV with pixelated ambilight. In: Proceeding of the 10th annual international workshop on presence. Barcelona, Spain, pp 339–344

  15. Storms RL, Zyda MJ (2000) Interactions in perceived quality of auditory-visual displays. Presence: Teleoper Virtual Environ 9(6):557–580

    Article  Google Scholar 

  16. The WebKit Open Source Project (2011) WebKit website. http://webkit.org/. Accessed 16 Nov 2011

  17. Timmerer C, Waltl M, Hellwagner H (2010) Are sensory effects ready for the World Wide Web? In: Proceedings of the Workshop on Interoperable Social Multimedia Applications (WISMA’10). Barcelona, Spain

  18. Vande Moere A (2005) Infostudio: teaching ambient display design using home automation. In: Proceedings of the 19th conference of the Computer-Human Interaction Special Interest Group (CHISIG) of Australia on computer-human interaction (OZCHI’05). Narrabundah, Australia, pp 1–4

  19. W3C (2008) Video in the Web activity statement. http://bit.ly/vTDFZK. Accessed 16. Nov 2011

  20. Waltl M, Timmerer C, Hellwagner H (2009) A test-bed for quality of multimedia experience evaluation of sensory effects. In: Proceedings of the 1st int’l workshop on Quality of Multimedia Experience (QoMEX’09). San Diego, USA

  21. Waltl M, Timmerer C, Hellwagner H (2010) Improving the quality of multimedia experience through sensory effects. In: Proceedings of the 2nd int’l workshop on Quality of Multimedia Experience (QoMEX’10). Trondheim, Norway

  22. Waltl M, Timmerer C, Hellwagner H (2010) Increasing the user experience of multimedia presentations with sensory effects. In: Proceedings of the 11th int’l Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS’10). Desenzano del Garda, Italy

  23. Wisneski C, Ishii H, Dahley A, Gorbet M, Brave S, Ullmer B, Yarin P (1998) Ambient displays: turning architectural space into an interface between people and digital information. Lecture notes in computer science, vol 1370. Springer-Verlag, London, pp 22–32

    Google Scholar 

  24. YouTube Blog (2009) Now in 3D: join the experiment with us! http://bit.ly/lZ6pd. Accessed 16 Nov 2011

  25. Yoon K, Choi BS, Lee ES, Lim TB (2010) 4-D broadcasting with MPEG-V. In: IEEE international workshop on MultiMedia Signal Processing (MMSP’10). Saint-Malo, France, pp 257–262

  26. Yun JK, Jang JH, Park KR, Han DW (2009) Real-sense media representation technology using multiple devices synchronization. Software technologies for embedded and ubiquitous Systems. Lecture notes in computer science, vol 5860. Springer-Verlag, Berlin / Heidelberg, pp 343–353

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the EC in the context of the ALICANTE (FP7-ICT-248652) and SocialSensor (FP7-ICT-287975), and QUALINET (COST IC 1003) projects.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Markus Waltl.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Waltl, M., Timmerer, C., Rainer, B. et al. Sensory effects for ambient experiences in the World Wide Web. Multimed Tools Appl 70, 1141–1160 (2014). https://doi.org/10.1007/s11042-012-1099-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1099-8

Keywords

Navigation