skip to main content
10.1145/1159913.1159959acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
Article
Free access

Quantifying Skype user satisfaction

Published: 11 August 2006 Publication History

Abstract

The success of Skype has inspired a generation of peer-to-peer-based solutions for satisfactory real-time multimedia services over the Internet. However, fundamental questions, such as whether VoIP services like Skype are good enough in terms of user satisfaction,have not been formally addressed. One of the major challenges lies in the lack of an easily accessible and objective index to quantify the degree of user satisfaction.In this work, we propose a model, geared to Skype, but generalizable to other VoIP services, to quantify VoIP user satisfaction based on a rigorous analysis of the call duration from actual Skype traces. The User Satisfaction Index (USI) derived from the model is unique in that 1) it is composed by objective source-and network-level metrics, such as the bit rate, bit rate jitter, and round-trip time, 2) unlike speech quality measures based on voice signals, such as the PESQ model standardized by ITU-T, the metrics are easily accessible and computable for real-time adaptation, and 3) the model development only requires network measurements, i.e., no user surveys or voice signals are necessary. Our model is validated by an independent set of metrics that quantifies the degree of user interaction from the actual traces.

References

[1]
S. A. Baset and H. Schulzrinne. An analysis of the Skype peer-to-peer internet telephony protocol. In Proceedings of IEEE INFOCOM '06, Barcelona, Spain, Apr. 2006.
[2]
T. Berson. Skype security evaluation. ALR-2005-031, Anagram Laboratorie, 2005.
[3]
D. R. Cox and D. Oakes. Analysis of Survival Data. Chapman & Hall/CRC, June 1984.
[4]
D. R. Cox and E. J. Snell. A general definition of residuals (with discussion). Journal of the Royal Statistical Society, B 30:248--275, 1968.
[5]
I. Daubechies. The wavelet transform, time-frequency localization and signal analysis. IEEE Transactions on Information Theory, 36(5):961--1005, Sept. 1990.
[6]
D. L. Donoho. De-noising by soft-thresholding. IEEE Transactions on Information Theory, 41(3):613--627, May 1995.
[7]
F. E. Harrell. Regression Modeling Strategies, with Applications to Linear Models, Survival Analysis and Logistic Regression. Springer, 2001.
[8]
D. P. Harrington and T. R. Fleming. A class of rank test procedures for censored survival data. Biometrika, 69:553--566, 1982.
[9]
ITU-T Recommendation P.862. Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs, Feb 2001.
[10]
K. Lam, O. Au, C. Chan, K. Hui, and S. Lau. Objective speech quality measure for cellular phone. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 1, pages 487--490, 1996.
[11]
A. Rix, J. Beerends, M. Hollier, and A. Hekstra. Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs. In proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 2, pages 73--76, 2001.
[12]
K. Suh, D. R. Figueiredo, J. Kurose, and D. Towsley. Characterizing and detecting relayed traffic: A case study using Skype. In Proceedings of IEEE INFOCOM '06, Barcelona, Spain, Apr. 2006.
[13]
T. M. Therneau and P. M. Grambsch. Modeling Survival Data: Extending the Cox Model. Springer, 1st edition, August 2001.

Cited By

View all
  • (2023)Estimating WebRTC Video QoE Metrics Without Using Application HeadersProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624828(485-500)Online publication date: 24-Oct-2023
  • (2022)PAINT: Path Aware Iterative Network Tomography for Link Metric Inference2022 IEEE 30th International Conference on Network Protocols (ICNP)10.1109/ICNP55882.2022.9940432(1-12)Online publication date: 30-Oct-2022
  • (2022)Generation of realistic cloud access times for mobile application testing using transfer learningComputer Communications10.1016/j.comcom.2021.03.010172:C(196-215)Online publication date: 23-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGCOMM '06: Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications
September 2006
458 pages
ISBN:1595933085
DOI:10.1145/1159913
  • cover image ACM SIGCOMM Computer Communication Review
    ACM SIGCOMM Computer Communication Review  Volume 36, Issue 4
    Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications
    October 2006
    445 pages
    ISSN:0146-4833
    DOI:10.1145/1151659
    Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 August 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. VoIP
  2. human perception
  3. internet measurement
  4. quality of service
  5. survival analysis
  6. wavelet denoising

Qualifiers

  • Article

Conference

SIGCOMM06
Sponsor:
SIGCOMM06: ACM SIGCOMM 2006 Conference
September 11 - 15, 2006
Pisa, Italy

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)129
  • Downloads (Last 6 weeks)16
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Estimating WebRTC Video QoE Metrics Without Using Application HeadersProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624828(485-500)Online publication date: 24-Oct-2023
  • (2022)PAINT: Path Aware Iterative Network Tomography for Link Metric Inference2022 IEEE 30th International Conference on Network Protocols (ICNP)10.1109/ICNP55882.2022.9940432(1-12)Online publication date: 30-Oct-2022
  • (2022)Generation of realistic cloud access times for mobile application testing using transfer learningComputer Communications10.1016/j.comcom.2021.03.010172:C(196-215)Online publication date: 23-Apr-2022
  • (2021)Modeling of quality of experience for web-based unified communications with perceptual dimensionsSignal, Image and Video Processing10.1007/s11760-020-01822-015:5(977-985)Online publication date: 3-Jan-2021
  • (2020)Relay strategy in online mobile gamesAdjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers10.1145/3410530.3414595(605-615)Online publication date: 10-Sep-2020
  • (2020)Benchmarking Video Service Quality: Quantifying the Viewer Impact of Loss-Related ImpairmentsIEEE Transactions on Network and Service Management10.1109/TNSM.2020.299890517:3(1640-1652)Online publication date: Sep-2020
  • (2020)A Latent Feelings-aware RNN Model for User Churn Prediction with only Behaviour data2020 IEEE International Conference on Smart Data Services (SMDS)10.1109/SMDS49396.2020.00011(26-35)Online publication date: Oct-2020
  • (2020)Quality of experience for unified communicationsInternational Journal of Network Management10.1002/nem.208330:3Online publication date: 14-May-2020
  • (2018)Understanding Gaming Experience in Mobile Multiplayer Online Battle Arena GamesProceedings of the 28th ACM SIGMM Workshop on Network and Operating Systems Support for Digital Audio and Video10.1145/3210445.3210450(25-30)Online publication date: 12-Jun-2018
  • (2018)EQACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/31704303:1(1-20)Online publication date: 13-Feb-2018
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media