research-article

A Generic Utility Model Representing the Quality of Sensory Experience

Authors:

Benjamin Rainer,

Christian TimmererAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 11, Issue 1s

Article No.: 14, Pages 1 - 17

https://doi.org/10.1145/2648429

Published: 01 October 2014 Publication History

Abstract

Current QoE research is mainly focusing on single modalities (audio, visual) or combinations thereof. In our research, we propose annotating traditional multimedia content with additional sensory effects, such as ambient light, vibration, wind, and olfaction, which could potentially stimulate all human senses. Investigating the influence of individual sensory effects and combinations thereof is important in order to understand how these individual sensory effects influence the Quality of Experience (QoE) as a whole. In this article, we describe the results of such a subjective quality assessment of audio-visual sequences which are annotated with additional sensory effects such as ambient light, wind, and vibration using the MPEG-V standard. The results of this assessment allow us to derive a utility model representing the Quality of Sensory Experience (QuaSE) complementary to existing QoE models described in terms of Quality of Service (QoS) parameters. For validating our proposed utility model, we provide an example instantiation and validate it against results of subjective quality assessments.

References

[1]

Markus Fiedler, Tobias Hossfeld, and Phuoc Tran-Gia. 2010. A generic quantitative relationship between quality of experience and quality of service. IEEE Network 24, 2 (2010), 36--41.

Digital Library

[2]

Georghita Ghinea and Oluwakemi Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1 (2012), Article 2, 17 pages.

Digital Library

[3]

David S. Hands. 2004. A basic multimedia quality model. IEEE Trans. Multimedia 6, 6 (2004), 806--816.

Digital Library

[4]

T. Hossfeld, D. Hock, P. Tran-Gia, K. Tutschku, and M. Fiedler. 2008. Testing the IQX hypothesis for exponential interdependency between QoS and QoE of voice codecs iLBC and G.711. In Proceedings of the 18th ITC Specialist Seminar on Quality of Experience.

[5]

Yutaka Ishibashi, Sosuke Hoshino, Qi Zeng, Norishige Fukushima, and Shinji Sugawara. 2012. QoE assessment of fairness between players in networked game with olfaction. In Proceedings of the 11th Annual Workshop on Network and Systems Support for Games (NetGames'12). IEEE Press, Article 12, 2 pages. http://dl.acm.org/citation.cfm&quest;id=2501560.2501577.

Digital Library

[6]

ISO. 2000. ISO/IEC 13818-1. Information technology - Generic coding of moving pictures and associated audio information: Systems. ISO.

[7]

ISO. 2011. ISO/IEC 23005. Information technology - Media context and control - Sensory information. ISO.

[8]

ITU. 2011. Rec. ITU-R BT.500-11. Technical Report. ITU.

[9]

Timothy Keith. 2006. Multiple Regression and Beyond. Pearson College Division. http://books.google.at/books&quest;id=CKprQgAACAAJ.

[10]

Ingo Kofler and Hermann Hellwagner. 2006. MPEG-21-based cross-resource adaptation decision-taking. In Proceedings of the 2nd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS), Ng Kia, Atta Badii, and Pierfrancesco Bellini (Eds.). Firenze University Press, 207--214.

[11]

Patrick Le Callet, Sebastian Möller, and Andrew Perkis. 2012. Qualinet white paper on definitions of quality of experience. In Proceedings of the European Network on Quality of Experience in Multimedia Systems and Services (COST Action IC 1003). http://www.qualinet.eu/.

[12]

Niall Murray, Yuansong Qiao, Brian Lee, Kotegar Karunakar, and Gabriel-Miro Muntean. 2013. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). ACM, New York, NY, 162--171.

Digital Library

[13]

Fernando Pereira. 2005. A triple user characterization model for video adaptation and quality of experience evaluation. In Proceedings of the IEEE 7th Workshop on Multimedia Signal Processing, 1--4.

[14]

Benjamin Rainer, Markus Waltl, Eva Cheng, Muawiyath Shujau, Christian Timmerer, Stephen Davis, Ian Burnett, and Hermann Hellwagner. 2012. Investigating the impact of sensory effects on the quality of experience and emotional respone in Web videos. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12), Ian Burnett and Henry Wu (Eds.). IEEE, 278--283. http://www.qomex2012.org.

[15]

Peter Reichl, Sebastian Egger, Raimund Schatz, and Alessandro D'Alconzo. 2010. The logarithmic nature of QoE and the role of the Weber-Fechner law in QoE assessment. In Proceedings of the IEEE International Conference on Communications (ICC). 1--5.

[16]

John A. Rice. 2007. Mathematical Statistics and Data Analysis. Thomson/Brooks/Cole. http://books.google.nl/books&quest;id=EKA-yeX2GVgC.

[17]

Sensory Experience Lab. 2014. http://selab.itec.aau.at. (2014).

[18]

Choi Bum Suk, Joo Sang Hyun, and Lee Hea Yong. 2009. Sensory effect metadata for SMMD media service. In Proceedings of the 4th International Conference on Internet and Web Applications and Services (ICIW'09). 649--654.

Digital Library

[19]

Christian Timmerer, Markus Waltl, Benjamin Rainer, and Hermann Hellwagner. 2012. Assessing the quality of sensory experience for multimedia presentations. Signal Process.: Image Commun. 27, 8 (September 2012), 909--916.

Digital Library

[20]

Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010a. Improving the quality of multimedia experience through sensory effects. In Proceedings of the 2nd International Workshop on Quality of Multimedia Experience (QoMEX'10), Andrew Perkis, Sebastian Möller, Peter Svensson, and Amy Reibman (Eds.). IEEE, Los Alamitos, CA, 124--129.

[21]

Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010b. Increasing the user experience of multimedia presentations with sensory effects. In Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'10), Riccardo Leonardi, Pierangelo Migliorati, and Andrea Cavallaro (Eds.). IEEE, Los Alamitos, CA, 1--4.

[22]

Markus Waltl, Christian Timmerer, Benjamin Rainer, and Hermann Hellwagner. 2012a. Sensory effect dataset and test setups. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12), Ian Burnett and Henry Wu (Eds.). IEEE, Los Alamitos, CA, 115--120. http://www.qomex2012.org.

[23]

Markus Waltl, Christian Timmerer, Benjamin Rainer, and Hermann Hellwagner. 2012b. Sensory effects for ambient experiences in the World Wide Web. Multimedia Tools Appl. 70, 2 (May 2012), 1--20.

Digital Library

[24]

Markus Waltl, Benjamin Rainer, Christian Timmerer, and Hermann Hellwagner. 2012c. A toolset for the authoring, simulation, and rendering of sensory experiences. In Proceedings of the 20th ACM Multimedia (MM'12), Noboru Babaguchi, Kiyoharu Aizawa, and John Smith (Eds.). ACM, 1469--1472. http://www.acmm2012.org.

Digital Library

[25]

Kyoungro Yoon, Bumsuk Choi, Eun-Seo Lee, and Tae-Beom Lim. 2010. 4-D broadcasting with MPEG-V. In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP). 257--262.

Cited By

Alkasasbeh ASpyridonis FGhinea G(2021)When Scents Help Me Remember My PasswordACM Transactions on Applied Perception10.1145/346988918:3(1-18)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3469889
Saleme ECovaci AMesfin GSantos CGhinea G(2019)Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia EnvironmentACM Computing Surveys10.1145/331985352:3(1-29)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3319853
Petrangeli SHooft JWauters TTurck F(2018)Quality of Experience-Centric Management of Adaptive Video Streaming ServicesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/316526614:2s(1-29)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1145/3165266
Show More Cited By

Index Terms

A Generic Utility Model Representing the Quality of Sensory Experience
1. Mathematics of computing
  1. Information theory

Recommendations

Assessing the quality of sensory experience for multimedia presentations

This paper introduces the concept of sensory experience by utilizing sensory effects such as wind or lighting as another dimension which contributes to the quality of the user experience. In particular, we utilize a representation format for sensory ...
An end-to-end tool chain for Sensory Experience based on MPEG-V

This paper provides an overview of our research conducted in the area of Sensory Experience including our implementations using MPEG-V Part 3 entitled ''Sensory Information''. MPEG-V Part 3 introduces Sensory Experience as a tool to increase the Quality ...
Sensory effects for ambient experiences in the World Wide Web

More and more content in various formats becomes available via the World Wide Web (WWW). Currently available Web browsers are able to access and interpret these contents (i.e., Web videos, text, image, and audio). These contents stimulate only senses ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 11, Issue 1s

Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and Applications

September 2014

260 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2675060

Editors:
Ralf Steinmetz
Technische Universität Darmstadt, Germany
,
Gheorghita Ghinea,
Christian Timmerer,
Weisi Lin,
Stephen Gulliver,
Zheng-Jun Zha
Institute of Intelligent Machines, Chinese Academy of Sciences
,
Lei Zhang
Bing Multimedia Search, Microsoft Corporation
,
Max Mühlhäuser
Department of Computer Science, Technische Universität Darmstadt
,
Alan F. Smeaton
Insight Centre for Data Analytics, Dublin City University

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2014

Accepted: 01 April 2014

Revised: 01 March 2014

Received: 01 November 2013

Published in TOMM Volume 11, Issue 1s

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Seventh Framework Programme
QUALINET (COST IC 1003) projects

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Alkasasbeh ASpyridonis FGhinea G(2021)When Scents Help Me Remember My PasswordACM Transactions on Applied Perception10.1145/346988918:3(1-18)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3469889
Saleme ECovaci AMesfin GSantos CGhinea G(2019)Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia EnvironmentACM Computing Surveys10.1145/331985352:3(1-29)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3319853
Petrangeli SHooft JWauters TTurck F(2018)Quality of Experience-Centric Management of Adaptive Video Streaming ServicesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/316526614:2s(1-29)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1145/3165266
Murray NMuntean GQiao YBrennan SLee B(2018)Modeling User Quality of Experience of Olfaction-Enhanced MultimediaIEEE Transactions on Broadcasting10.1109/TBC.2018.282529764:2(539-551)Online publication date: Jun-2018
https://doi.org/10.1109/TBC.2018.2825297
Jalal LMurroni M(2017)A nonlinear quality of experience model for high dynamic spatio-temporal mulsemedia2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX.2017.7965654(1-6)Online publication date: May-2017
https://doi.org/10.1109/QoMEX.2017.7965654
Jalal LMurroni M(2017)Enhancing TV broadcasting services: A survey on mulsemedia quality of experience2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB.2017.7986192(1-7)Online publication date: Jun-2017
https://doi.org/10.1109/BMSB.2017.7986192
Guedes ÁAzevedo RBarbosa S(2017)Extending multimedia languages to support multimodal user interactionsMultimedia Tools and Applications10.1007/s11042-016-3846-876:4(5691-5720)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-3846-8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents