skip to main content
10.1145/2072298.2071905acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Quality of experience evaluation of voice communication systems using affect-based approach

Published: 28 November 2011 Publication History

Abstract

The voice communication industry is undergoing a rapid phase change with continuously evolving technologies such as cellular, mobile and Internet telephony. Effective evaluation of system performance is becoming critical, which will serve as an important instrument for service providers to monitor and manage quality. Recently, Quality of Experience (QoE) metrics are found to be more valuable quality assessment mechanism since they are more closely related to human perception as compared to traditional QoS-based techniques. In this paper, we investigate a new affect-based approach for QoE evaluation. Our hypothesis states that QoE in voice communication is correlated to user's affective behavior, which will vary across networking conditions. We conduct extensive user study based on natural human-human voice communication. The experimental results indicate very promising prospect of this approach.

References

[1]
PJSIP:. http://www.pjsip.org/.
[2]
PortAudio:. http://www.portaudio.com/.
[3]
ITU-T rec. bs.1284--1: General methods for the subjective assessment of sound quality, 2003.
[4]
ITU-T Rec. G.107. The E-model, a computational model for use in transmission planning, 2005.
[5]
A. Batliner, K. Fischer, R. Huber, J. Spilker, and E. Nöth. How to find trouble in communication. Speech Commun., 40, 2003.
[6]
C.-C. Chang and C.-J. Lin. libSVM: a library for support vector machines. http://www.csie.ntu.edu.tw/ cjlin/libsvm, 2001.
[7]
K.-T. Chen, C.-C. Tu, and W.-C. Xiao. OneClick: A framework for measuring network quality of experience. In INFOCOM 2009, IEEE, 2009.
[8]
T. Ebrahimi. Quality of multimedia experience: past, present and future. In ACM, MM'09, NY, USA, 2009.
[9]
F. Eyben, M. Wöllmer, and B. Schuller. OpenSMILE: the munich versatile and fast open-source audio feature extractor. In ACM, MM'10, NY, USA, 2010.
[10]
A. Gorin, S. Levinson, L. Miller, A. Gertner, A. Ljolje, and E. Goldman. On adaptive acquisition of language. In ICASSP, 1990, volume 1, Apr. 1990.
[11]
M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The weka data mining software: an update. SIGKDD Explor. Newsl., 11, 2009.
[12]
A. Jaimes, N. Sebe, and D. Gatica-Perez. Human-centered computing: a multimedia perspective. In ACM, MM'06.
[13]
R. Jain. Quality of experience. Multimedia, IEEE, 11(1), jan.-march 2004.
[14]
C. M. Lee and S. Narayanan. Toward detecting emotions in spoken dialogs. IEEE TSAP, 13(2), march 2005.
[15]
D. Nahl. Learning the internet and the structure of information behavior. J. Am. Soc. Inf. Sci., 49, 1998.
[16]
B. Sat and B. W. Wah. Playout scheduling and loss-concealments in voip for optimizing conversational voice communication quality. In ACM, MM'07.
[17]
Z. Zeng, M. Pantic, G. Roisman, and T. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 31(1), 2009.

Cited By

View all
  • (2024)Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis2024 16th International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX61742.2024.10598261(15-21)Online publication date: 18-Jun-2024
  • (2022)Quality of Experience in Telemeetings and Videoconferencing: A Comprehensive SurveyIEEE Access10.1109/ACCESS.2022.317636910(63885-63931)Online publication date: 2022
  • (2018)Towards Individual QoE for Multiparty VideoconferencingIEEE Transactions on Multimedia10.1109/TMM.2017.277746620:7(1781-1795)Online publication date: Jul-2018
  • Show More Cited By

Index Terms

  1. Quality of experience evaluation of voice communication systems using affect-based approach

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      MM '11: Proceedings of the 19th ACM international conference on Multimedia
      November 2011
      944 pages
      ISBN:9781450306164
      DOI:10.1145/2072298
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 November 2011

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. affect computing
      2. quality of experience
      3. voice communication

      Qualifiers

      • Short-paper

      Conference

      MM '11
      Sponsor:
      MM '11: ACM Multimedia Conference
      November 28 - December 1, 2011
      Arizona, Scottsdale, USA

      Acceptance Rates

      Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 25 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis2024 16th International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX61742.2024.10598261(15-21)Online publication date: 18-Jun-2024
      • (2022)Quality of Experience in Telemeetings and Videoconferencing: A Comprehensive SurveyIEEE Access10.1109/ACCESS.2022.317636910(63885-63931)Online publication date: 2022
      • (2018)Towards Individual QoE for Multiparty VideoconferencingIEEE Transactions on Multimedia10.1109/TMM.2017.277746620:7(1781-1795)Online publication date: Jul-2018
      • (2014)A Quality of Experience Model for Haptic Virtual EnvironmentsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/254099110:3(1-23)Online publication date: 17-Apr-2014

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media