Skip to main content
SpringerLink
Log in

VoIP quality measurement: subjective VoIP quality estimation model for G.711 and G.729 based on native Thai users

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

This paper presents a mathematical model that has been created from the subjective MOS, instead of modifying or improving the existing objective measurement methods (e.g., E-model) for VoIP quality measurement. The proposed model of VoIP quality measurement method is based on native Thai users who communicate to each other using Thai language, which is a tonal language, unlike English and most western languages. The data have been gathered using conversation-opinion tests with 400 and 354 native Thai subjects for two popular codecs, G.711 and G.729, respectively, referring to effects from two major network factors, packet loss and packet delay. This model is called the Thai subjective VoIP quality evaluation model (ThaiVQE). It has been evaluated using two test sets of subjective MOS, from 50 native Thai subjects for G.711 and 64 native Thai subjects for G.729, then the results have been compared with the E-model results. Based on native Thai users, the evaluation result surprisingly shows that ThaiVQE can contribute better accuracy and reliability than the standard E-model with error reduction of over 13 % for G.711 and 28 % for G.729. Therefore, this is an example study for other countries that have their own languages and cultures to create their subjective MOS model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Mike, B.: VoIP is the Future of Global Telecommunications. WHICH VOIP. http://www.whichvoip.com/global-voip-trends.htm (2014). Accessed 29 April 2014

  2. Lunden, I.: VOIP BUSINESS MODELS: IP finds its voice. Total Telecom. http://www.totaltele.com/view.aspx?ID=458379 (2010). Accessed 29 April 2014

  3. Point Topic.: Global VoIP subscriber numbers—Q2 2013. Point Topic. http://point-topic.com/free-analysis/global-voip-subscriber-numbers-q2-2013/ (2013). Accessed 29 April 2014

  4. Yang, Q., Pitts, J.M.: Scalable voice over Internet protocol service-level agreement guarantees in converged transmission control protocol/Internet protocol networks. IET Commun. 4(8), 1026–1035 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  5. Rix, A.W.: Comparison between subjective listening quality and P.862 PESQ score. White paper, Psytechnics. https://www.google.co.th/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0CDAQFjAA&url=http%3A%2F%2Fwww.sageinst.com%2Fdownloads%2F960B%2Fwp_sub_v_pesq.pdf&ei=tSZuU7S5DcmrrAfWxoDYCg&usg=AFQjCNE5qYE4anR-WUBJ1dLDF8ey1jJ6wA&bvm=bv.66330100,d.bmk (2003). Accessed 10 May 2014

  6. ITU-T.: Question 7/12—methods, tools and test plans for the subjective assessment of speech, audio and audiovisual quality interactions. http://www.itu.int/ITU-T/studygroups/com12/sg12-q7.html (2012). Accessed 10 May 2014

  7. Cai, Z., Kitawaki, N., Yamada, T., Makino, S.: Comparison of MOS evaluation characteristics for Chinese, Japanese and English in IP telephony. In: Proceedings of IUCS 2010, Beijing, pp. 1–4 (2010)

  8. Takahashi, A., Kurashima, A., Yoshino, H.: Objective assessment methodology for estimating conversational quality in VoIP. IEEE Audio Speech Lang Process. 14(6), 1983–1993 (2006)

    Google Scholar 

  9. Ren, J., Zhang, C., Huang, W., Mao, D.: Enhancement to E-model on standard deviation of packet delay. In: Proceedings of ICIS 2010, Chengdu, pp. 256–259 (2010)

  10. Daengsi, T., Wutiwiwatchai, C., Preechayasomboon, A., Sukparungsee, S.: A study of VoIP quality evaluation: user perception of voice quality from G.729, G.711 and G.722. In: Proceedings of IEEE CCNC—SS-QoE, Lasvegas, pp. 342–345 (2012)

  11. Wutiwiwatchai, C., Furui, S.: Thai speech processing technology: a review. Speech Commun. 49, 8–27 (2007)

    Article  Google Scholar 

  12. Gandour, J., Wong, D., Hsieh, L., Weinzapfel, B., Lancker, D.V., Hutchins, G.D.: A crosslinguistic PET study of tone perception. J. Cogn. Neurosci. 12(1), 207–222 (2000)

    Article  Google Scholar 

  13. Sittiprapaporn, W., Chindaduangratn, C., Kotchabhakdi, N.: Long-term memory traces for familiar spoken words in tonal languages as revealed by the Mismatch negativity. Songklanakarin J. Sci. Technol. 26(6), 779–786 (2004)

    Google Scholar 

  14. The Hofstede Centre.: ​National Culture. http://geert-hofstede.com/national-culture.html. Accessed 30 April 2014

  15. Sathapornvajana, S., Papasratorn, B.: Effect of culture, age, and language on quality of services and adoption of IP applications. Wirel. Pers. Commun. 69, 1067–1075 (2013)

    Article  Google Scholar 

  16. Khan, A., Sun, L., Jammeh, E., Ifeachor, E.: Quality of experience-driven adaptation scheme for video applications over wireless networks. IET Commun. 4(11), 1337–1347 (2010)

    Article  Google Scholar 

  17. ITU-T.: ITU-T Recommendation P.10/G.100 Vocabulary for performance and quality of service, Amendment 1—New Appendix I—Definition of Quality of Experience (QoE) (2007)

  18. Scharts, R., Hoßfeld, T., Janowski, L., Egger, S.: From Packets to People: Quality of Experience as a New Measurement Challenge. Data Traffic Monitoring and Analysis (Book Section), Lecture Notes in Computer Science 7754, pp. 219–263 (2013)

  19. Batteram, H., Damm, G., Mukhopadhyay, A., Philippart, L., Odysseos, R., Urrutia-Valdés, C.: Delivering quality of experience in multimedia networks. Bell Labs Tech. J. 15(1), 175–194 (2010)

    Article  Google Scholar 

  20. Zepernick, H.-J., Engelke, U.: Quality of experience of multimedia services: past, present, and future. http://dcti.iscte.pt/events/qoemcs/papers/2011/Hans-juergen_QoEMCS.pdf (2011). Accessed 30 April 2014

  21. Lindeberg, M., Kristiansen, S., Plagemann, T., Goebel, V.: Challenges and techniques for video streaming over mobile ad hoc networks. Multimed. Syst. 17, 51–82 (2011)

    Article  Google Scholar 

  22. Narbutt, M., Davis, M.: Assessing the quality of VoIP transmission affected by playout buffer scheme. In: Proceedings of 4th MESAQIN 2005, Prague, http://wireless.feld.cvut.cz/mesaqin2005/papers/15_NARBUTT.pdf (2005). Accessed 30 April 2014

  23. Ding, L., Lin, Z., Radwan, A., El-Hennaway, M., Goubran, R.: Non-intrusive single-ended speech quality assessment in VoIP. Speech Commun. 49, 477–489 (2007)

    Article  Google Scholar 

  24. Goudarzi M (2008) Evaluation of Voice Quality in 3G Mobile Networks. Thesis, University of Plymouth

  25. Al-Akhras, M., Zedan, H., John, R., Almomani, I.: Non-intrusive speech quality prediction in VoIP networks using a neural network approach. Neurocomputing 72, 2595–2608 (2009)

    Article  Google Scholar 

  26. Mahdi, A.E., Picovici, D.: Advances in voice quality measurement in modern telecommunications. Dig. Signal Process. 19, 79–103 (2009)

    Article  Google Scholar 

  27. ITU-T.: ITU-T Recommendation P.800 Methods for subjective determination of transmission quality (1996)

  28. ITU-T.: ITU-T Recommendation P.805 Subjective evaluation of conversational quality (2007)

  29. Dymarski, P., Kula, S., Huy, T.N.: QoS conditions for VoIP and VoD. J. Telecommun. Inf. Technol. 3, 29–37 (2011)

    Google Scholar 

  30. Daengsi, T., Sukparungsee, S., Wutiwiwatchai, C., Preechayasomboon, A.: Comparison of perceptual voice quality of VoIP provided by G.711 and G.729 using conversation-opinion tests. Int. J. Comput. Internet Manag. 20(1), 2012–2026 (2012)

    Google Scholar 

  31. http://ieeexplore.ieee.org/search/searchresult.jsp?queryText%3DE-model&addRange=2000_2014_Publication_Year&pageNumber=1&resultAction=REFINE. Accessed on April 27 2014

  32. ITU-T.: ITU-T Recommendation G.107 The E-model: a computational model for use in transmission planning (2011)

  33. ITU-T.: ITU-T Recommendation P.800.1 Mean Opinion Score (MOS) terminology (1996)

  34. ITU-T.: ITU-T Recommendation G.107 The E-model: a computational model for use in transmission planning (2009)

  35. Voznak, M.: Non-intrusive speech quality assessment in simplified E-Model. WSEAS Trans. Syst. 11(8), 315–325 (2012)

    Google Scholar 

  36. Voznak, M.: E-model modification for case of cascade codecs arrangement. Int. J. Math. Model Met. Appl. Sci. 6(8), 1301–1309 (2011)

    Google Scholar 

  37. Zhang, H., Xie, L., Byun, J., Flynn, P., Shim, C.: Packet loss burstiness and enhancement to the E-model. In: Proceedings of SNPD/SAWN 2005, Towson, pp. 214–219 (2005)

  38. Zheng, H., Lin, Q.: Non-intrusive speech quality assessment in VoIP using the extended E-model. Energy Proc. 13, 6867–6874 (2011)

    Article  Google Scholar 

  39. Ding, L., Goubran, R.A.: Speech quality prediction in VoIP using the extended E-model. In: Proceedings of IEEE GLOBECOM 2003, San Francisco, vol. 7, pp. 3974–3978 (2003)

  40. Assem, H., Malone, D., Dunne, J., O’Sullivan, P.: Monitoring VoIP call quality using improved simplified E-model. In: Proceedings of ICNC 2013, San Diego, pp. 927–931 (2013)

  41. ITU-T.: ITU-T Recommendation G.711, pulse code modulation (PCM) of voice frequencies (1988)

  42. ITU-T.: ITU-T Recommendation G.729, coding of speech at 8 kb/s using conjugate-structure algebraic-code-excited linear prediction (CS-ACELP) (2012)

  43. Daengsi, T., Yochanang, K., Wuttiditachotti, P.: A study of perceptual VoIP quality evaluation with Thai users and codec selection using voice quality: bandwidth tradeoff analysis. In: Proceedings of ICTC 2013, Jeju, pp. 691–696 (2013)

  44. Karapantazis, S., Pavlidou, F.-N.: VoIP: A comprehensive survey on a promising technology. Comput. Netw. 53(12), 2050–2090 (2009)

    Article  Google Scholar 

  45. ITU-T.: ITU-T Recommendation P.862.3 application guide for objective quality measurement based on recommendations P.862, P.862.1 and P.862.2 (2007)

  46. Szigeti, T., Hattingh, C., Barton, R., Briley, K.: Quality of service design overview. Cisco. http://www.cisco.com/c/en/us/td/docs/solutions/Enterprise/WAN_and_MAN/QoS_SRND/QoS-SRND-Book/QoSIntro.html (2013). Accessed 27 April 2014

  47. http://ieeexplore.ieee.org/search/searchresult.jsp?queryText%3DVoIP+Quality&addRange=2000_2014_Publication_Year&pageNumber=1&resultAction=REFINE. Accessed 27 April 2014

  48. http://ieeexplore.ieee.org/search/searchresult.jsp?newsearch=true&queryText=VoIP+Quality+Packet+Delay. Accessed 27 April 2014

  49. http://ieeexplore.ieee.org/search/searchresult.jsp?newsearch=true&queryText=VoIP+Quality+Packet+Loss&x=0&y=0. Accessed 27 April 2014

  50. ETSI.: Telecommunications and internet protocol harmonization over networks (TIPHON) Release 3; End-to-end Quality of Service in TIPHON systems; Part 7: design guide for elements of a TIPHON connection from an end-to-end speech transmission performance point of view. http://www.etsi.org/deliver/etsi_tr/101300_101399/10132907/02.01.01_60/tr_10132907v020101p.pdf (2002). Accessed 27 April 2014

  51. Avaya Labs.: Avaya IP voice quality network requirement. http://downloads.avaya.com/css/P8/documents/100018203 (2009). Accessed 30 April 2014

  52. ITU-T.: ITU-T Recommendation G.114. One-way transmission time (2003)

  53. Boutremans, C., Iannaccone, G., Diot, C. Impact of link failures on VoIP performance. http://www.recursosvoip.com/docs/english/voip-nossdav.pdf (2002). Accessed 30 April 2014

  54. Markopoulou, A., Iannaccone, G., Bhattacharyya, S., Chuah, C.-N., Diot, C.: Characterization of failures in an IP backbone. In: Proceedings of IEEE INFOCOM 2004, Hong Kong, pp. 2307–2317 (2004)

  55. Sun, L., Ifeachor, E.C., Perceived speech quality prediction for voice over IP-based networks. In: Proceedings of IEEE ICC 2002, New York, vol. 4, pp. 2573–2577 (2002)

  56. Fluke. Quality management: Troubleshooting techniques for voice over IP. Tequipment. http://www.tequipment.net/assets/1/26/Documents/ApplicationNote-QualityManagement-TroubleshootingTechniquesForVoiceOverIP.pdf (2005). Accessed 29 April 2014

  57. Ren, J., Zhang, H., Zhu, Y., Gao, C. Assessment of effects of different language in VOIP. In: Proceedings of ICALIP 2008, Shanghai, pp. 1624–1628 (2008)

  58. Daengsi, T., Wuttidittachotti, P. VoIP quality measurement: enhanced E-model using bias factor. In: Proceedings of IEEE Globecom 2013, Atlanta, pp. 1351–1356 (2013)

  59. Rahdari, F., Eftekhari, M., Akbari, A., Zeinalkhani, M.: Developing fuzzy models for estimating the quality of VoIP. Iran. J. Fuzzy Syst. 11(1), 49–73 (2013)

    MathSciNet  Google Scholar 

  60. Calyam, P., Ekici, E., Lee, C.-G., Haffner, M., Howes, N.: A “GAP-model” based framework for online VVoIP QoE measurement. J. Commun. Netw. 9(4), 446–456 (2007)

    Article  Google Scholar 

  61. Sun, L. Speech quality prediction for voice over internet protocol networks. Dissertation, University of Plymouth (2004)

  62. Yaodu, W., Xiang, X., Jingming, K., Chillon, M.G.: Subjective speech quality evaluation based on collecting opinions via internet. In: Proceedings of international conference communications and mobile computing 2010, Shenzhen, pp. 517–521 (2010)

  63. Daengsi, T., Wuttidittachotti, P., Preechayasomboon, A., Wutiwiwatchai, C., Sukparungsee, S.: VoIP quality of experience: a proposed subjective MOS estimation model based-on Thai users. In: Proceedings of ICUFN 2013, Da Nang, pp. 407–412 (2013)

  64. Khitmah, N., Daengsi, T., Wuttidittachotti, P.: A subjective—VoIP quality estimation model for G.729 based on native Thai users. In: Proceedings of ICACT 2014, Pyeongchang, pp. 48–53 (2014)

  65. Sun, L., Ifeachor, E.C.: Voice quality prediction models and their application in VoIP networks. IEEE Trans. Multimed. 8(4), 809–820 (2006)

    Article  Google Scholar 

  66. Simionovici, A.-M., Tantar, A.-A., Bouvry, P., Didelot, L.: Predictive modeling in a VoIP system. J. Telecommun. Inf. Technol. 4, 32–40 (2013)

    Google Scholar 

  67. Babinec, S., Pospchal, J.: Modular echo state neural networks in time series prediction. Comput. Inf. 30(2), 321–334 (2011)

    Google Scholar 

  68. Chen, R.J.C., Bloomfield, P., Cubbage, F.W.: Comparing forecasting models in tourism. J. Hosp. Tour. Res. 32, 3–21 (2008)

    Article  Google Scholar 

  69. Johannesson, N.O.: The ETSI computation model: a tool for transmission planning of telephone networks. IEEE Commun. Mag. 35, 70–79 (1997)

    Article  Google Scholar 

Download references

Acknowledgments

We thank all the participants/staff/lecturers of KMUTNB, who were involved in the study. We also thank Mr. Nattawut Unwanatham and Mr. Jakkapong Polpong for providing support in the tests with G.711 and G.729, respectively. Thank you the Central Library, KMUTNB, for the area to conduct the tests. We immensely thank Mr. Tuul Triyason, Asst. Prof. Dr. Vajirasak Vanijja and VoIP Laboratory in KMUTT for E-model tool and Mr. Gary Sherriff for editing. Lastly, this paper is dedicated to the old advisor of the 1st author, Dr. Gareth Clayton who sadly passed away in 2010, after giving the important idea to start this research.

Author information

Authors and Affiliations

  1. Enterprise Services, JADS Comm Limited, Bangkok, Thailand

    Therdpong Daengsi

  2. Department of Information Technology, Faculty of Information Technology, KMUTNB, Bangkok, Thailand

    Nalakkhana Khitmoh & Pongpisit Wuttidittachotti

Authors
  1. Therdpong Daengsi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nalakkhana Khitmoh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pongpisit Wuttidittachotti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Therdpong Daengsi.

Additional information

Communicated by M. Zink.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Daengsi, T., Khitmoh, N. & Wuttidittachotti, P. VoIP quality measurement: subjective VoIP quality estimation model for G.711 and G.729 based on native Thai users. Multimedia Systems 22, 575–586 (2016). https://doi.org/10.1007/s00530-015-0468-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-015-0468-3

Keywords

Search

Navigation