Skip to main content
SpringerLink
Log in

A remote display QoE improvement scheme for interactive applications in low network bandwidth environment

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Screen transmission is an essential part of Desktop as a Service (DaaS) which directly influence the quality of experience (QoE). In this paper, we propose a novel QoE improvement scheme that dynamically controls the quality setting of the image compression before the screen transmission to decrease response time of the system still maintaining the satisfactory image quality, hence improves the QoE in interactive applications in a band-limited environment. The proposed scheme first selects the best quality setting appropriate for current network bandwidth quota, then uses the remaining bandwidth to improve the quality setting of low motion regions without any adverse effect on response time. To enable the adaptive quality selection and image quality refinement, we propose a compressed image file size inference model and a block priority calculation method respectively. Particularly, we implement our QoE Improvement Scheme to work with screen content coding. Both quantitative measurements and users’ evaluations in the experiments show that our QoE improvement scheme improves QoS as well as QoE by utilizing the available network bandwidth efficiently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Notes

  1. We compute network bandwidth quota for a frame buffer update based on the end-to-end network bandwidth and an expected response time.

  2. In this paper, we choose JPEG as our target image encoder. However, the same procedure can be applied to other image compressions in constructing similar models.

References

  1. Abu L Md, TaeChoong C, Eui-Nam H (2016) Adaptive desktop delivery scheme for provisioning quality of experience in cloud desktop as a service. Comput J 59(2):260–274. doi:10.1093/comjnl/bxv116. http://comjnl.oxfordjournals.org/content/59/2/260

    Article  Google Scholar 

  2. An NT, Huynh Ct, Lee B, Hong CS (2014) An efficient block classification for media healthcare service in mobile cloud computing. Multimed Tools Appl 1–15.

  3. Deboosere L, De Wachter J, Simoens P, De Turck F, Dhoedt B, Demeester P (2007) Thin client computing solutions in low- and high-motion scenarios. In: 3rd international conference on networking and services, ICNS 2007. doi:10.1109/ICNS.2007.115

  4. Fei-Fei L, Fergus R, Perona P (2004) Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: Conference on computer vision and pattern recognition workshop (CVPR 2004), p 178. doi:10.1109/CVPR.2004.109

  5. Fenner W C, McCanne S, Berc LM, Frederick R (1995) RTP payload format for JPEG-compressed video (internet draft IETF). Tech Rep. IETF 59(2):260–274. https://tools.ietf.org/html/rfc2035, accessed 10 October 2016

    Google Scholar 

  6. Huang A, Dijiang (2011) Mobile cloud computing. IEEE COMSOC Multimed Commun Tech Committee (MMTC) E-Lett 6(10):27–31

    Google Scholar 

  7. ITU-T Recommendations (2012) Methodology for the subjective assessment of the quality of television pictures. Int Telecommun Union 1–48. http://www.itu.int/rec/R-REC-BT.500/en

  8. ITU-T Recommendation (2014) Requirements for desktop as a service, International Telecommunications Union, Geneva, Switzerland. https://www.itu.int/rec/T-REC-Y.3503-201405-I/en, accessed 10 October 2016

  9. ITU-T Recommendation (2016) H.264: advanced video coding for generic audiovisual services, International Telecommunications Union, Geneva, Switzerland. https://www.itu.int/rec/T-REC-H.264, accessed 10 October 2016

  10. Jing W, Xuetao G, Yang Z (2013) An adaptive encoding application sharing system based on remote display. In: Proceedings of the 2013 3rd international conference on intelligent system design and engineering applications, ISDEA 2013, pp 266–269. doi:10.1109/ISDEA.2012.66

  11. Kaplinsky KV (2001a) Vnc tight encoder - comparison results. http://www.tightvnc.com/archive/compare.html, accessed 12 September 2016

  12. Kaplinsky KV (2001b) VNC tight encoder-data compression for VNC. In: Proceedings of the 7th International scientific and practical conference of students, post-graduates and young scientists: modern techniques and technology, MTT 2001, pp 155–157

  13. Layek A, Chung T, Huh E (2016) Efficient screen splitting methods - a case study in block-wise motion detection. KSII Trans Internet Inf Syst 10(10):5074—5094. doi:10.3837/tiis.2016.10.024

    Google Scholar 

  14. Lin T, Hao P (2005) Compound image compression for real-time computer screen image transmission. IEEE Trans Image Process 14 (8):993–1005. doi:10.1109/TIP.2005.849776

    Article  MathSciNet  Google Scholar 

  15. Melorose J, Perroy R, Careas S (2015) The remote framebuffer protocol. Statewide Agri Land Use Baseline 1:1–39. doi:10.1017/CBO9781107415324.004. arXiv:1011.1669v3

    Google Scholar 

  16. Microsoft (2016) Microsoft remote desktop protocol: basic connectivity and graphics remoting specification. https://msdn.microsoft.com/en-us/library/cc240445.aspx, accessed 13 March 2017

  17. Simoens P, Praet P, Vankeirsbilck B, De Wachter J, Deboosere L, De Turck F, Dhoedt B, Demeester P (2008) Design and implementation of a hybrid remote display protocol to optimize multimedia experience on thin client devices. In: Proceedings of the 2008 Australasian telecommunication networks and applications conference, ATNAC 2008, pp 391–396. doi:10.1109/ATNAC.2008.4783356

  18. Song B, Tang W, Nguyen TD, Hassan MM, Huh EN (2013) An optimized hybrid remote display protocol using GPU-assisted M-JPEG encoding and novel high-motion detection algorithm. J Supercomput 66(3):1729–1748. doi:10.1007/s11227-013-0972-1

    Article  Google Scholar 

  19. Theora (2011) Theora Specification, video for everyone. http://theora.org/doc/Theora.pdf, accessed 10 October 2016

  20. Tolia N, Andersen DG, Satyanarayanan M (2006) Quantifying interactive user experience on thin clients. Computer 39(3):46–52. doi:10.1109/MC.2006.101

    Article  Google Scholar 

  21. Wallace GK (1992) The JPEG still picture compression standard. IEEE Trans Consum Electron 38(1):xviii–xxxiv. doi:10.1109/30.125072

    Article  Google Scholar 

  22. Wikipedia (2016e) Peak signal-to-noise ratio. https://en.wikipedia.org/w/index.php?title=Peak_signal-to-noise_rati&oldid=731597489, accessed 12 September 2016

  23. Zhang X J, Takahashi H (2007) A hybrid data compression scheme for improved VNC. Syst Cybern Inf 5(2):2–5

    Google Scholar 

  24. (2016a) libjpeg-turbo. http://www.libjpeg-turbo.org/, accessed 12 September 2016

  25. (2016b) Turbovnc. http://www.turbovnc.org//, accessed 19 September 2016

  26. (2016) Libvncserver. https://libvnc.github.io/, accessed 19 September 2016

  27. (2016) FreeRDP. http://www.freerdp.com, accessed 14 March 2017

Download references

Acknowledgements

This research was supported by the MSIP(Ministry of Science, ICT and Future Planning), Korea, under the ITRC(Information Technology Research Center) support program (IITP-2017-2013-0-00717) supervised by the IITP(Institute for Information & communications Technology Promotion)). Professor Eui-Nam Huh is the corresponding author.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Kyung Hee University, Global Campus, Yongin, South Korea

    Quang Thai Ngo, Layek Md. Abu, Xuan Qui Pham, Seungkyu Lee & Eui-Nam Huh

Authors
  1. Quang Thai Ngo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Layek Md. Abu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xuan Qui Pham
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seungkyu Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Eui-Nam Huh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eui-Nam Huh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ngo, Q., Md. Abu, L., Pham, X. et al. A remote display QoE improvement scheme for interactive applications in low network bandwidth environment. Multimed Tools Appl 76, 22217–22241 (2017). https://doi.org/10.1007/s11042-017-4692-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4692-z

Keywords

Search

Navigation