Flavia Salutari
ABSTRACT
The Web is one of the most successful Internet application. Yet, the quality of Web users' experience is still largely impenetrable. Whereas Web performances are typically gathered with controlled experiments, in this work we perform a large-scale study of one of the most popular websites,namely Wikipedia, explicitly asking (a small fraction of its) users for feedback on the browsing experience. We leverage user survey responses to build a data-driven model of user satisfaction which, despite including state-of-the art quality of experience metrics, is still far from achieving accurate results, and discuss directions to move forward. Finally, we aim at making our dataset publicly available, which hopefully contributes in enriching and refining the scientific community knowledge on Web users' quality of experience (QoE).
- 2010. World Wide Wait. https://www.economist.com/science-and-technology/2010/02/12/world-wide-wait.Google Scholar
- Eytan Bakshy, Dean Eckles, and Michael S. Bernstein. 2014. Designing and Deploying Online Field Experiments. In Proc. of the 23rd International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Athula Balachandran, Vaneet Aggarwal, Shobha, He Yan, 2014. Modeling Web Quality-of-experience on Cellular Networks. In Proc. ACM MOBICOM. ACM. Google ScholarDigital Library
- Enrico Bocchi, Luca De Cicco, and Dario Rossi. 2016. Measuring the Quality of Experience of Web Users. Proc. ACM SIGCOMM, Internet-QoE Workshop(2016).Google ScholarDigital Library
- Leo Breiman. 2001. Random Forests. Machine Learning 45, 1 (oct 2001), 5-32. Google ScholarDigital Library
- Jake Brutlag, Zoe Abrams, and Pat Meenan. {n. d.}. Above the fold time: Measuring Web page performance visually. http://conferences.oreilly.com/velocity/velocity-mar2011/public/schedule/detail/18692.Google Scholar
- Michael Butkiewicz, Daimeng Wang, Zhe Wu, Harsha V. Madhyastha, and Vyas Sekar. 2015. Klotski: Reprioritizing Web Content to Improve User Experience on Mobile Devices. In Proc. of the USENIX Conference on Networked Systems Design and Implementation (NSDI). Google ScholarDigital Library
- Vint Cerf, Van Jacobson, Nick Weaver, and Jim Gettys. 2012. BufferBloat: what's wrong with the internet?Commun. ACM 55, 2 (2012), 40-47. Google ScholarDigital Library
- Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proc. of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 785-794. Google ScholarDigital Library
- Diego Da Hora, Alemnew Asrese, Vassilis Christophides, Renata Teixeira, and Dario Rossi. 2018. Narrowing the gap between QoS metrics and Web QoE using Above-the-fold metrics. In Proc. Passive and Active Measurement Conference (PAM).Google ScholarCross Ref
- Mallesham Dasari, Santiago Vargas, Arani Bhattacharya, Aruna Balasubramanian, Samir R. Das, and Michael Ferdman. 2018. Impact of Device Performance on Mobile Internet QoE. In Proc. ACM Internet Measurement Conference. Google ScholarDigital Library
- Zhiheng Wang (Ed.). 2012. Navigation Timing. http://www.w3.org/TR/2012/REC-navigation-timing-20121217/. In ”W3C Recommendation”.Google Scholar
- Sebastian Egger, Peter Reichl, Tobias Hoβfeld, and Raimund Schatz. 2012. “Time is bandwidth”? Narrowing the gap between subjective time perception and Quality of Experience. In Proc. IEEE International Conference on Communications (ICC).Google ScholarCross Ref
- Jeffrey Erman, Vijay Gopalakrishnan, Rittwik Jana, and K. K. Ramakrishnan. 2013. Towards a SPDY'Ier Mobile Web?. In ACM CoNEXT. 303-314. Google ScholarDigital Library
- Markus Fiedler, Tobias Hoβfeld, and Phuoc Tran-Gia. 2010. A generic quantitative relationship between quality of experience and quality of service. IEEE Network 24, 2 (2010), 36-41. Google ScholarDigital Library
- Qingzhu Gao, Prasenjit Dey, and Parvez Ahammad. 2017. Perceived Performance of Top Retail Webpages In the Wild: Insights from Large-scale Crowdsourcing of Above-the-Fold QoE. In Proc. ACM SIGCOMM, Internet-QoE Workshop. Google ScholarDigital Library
- Tobias Hoβfeld, Poul E Heegaard, Martín Varela, and Sebastian Möller. 2016. QoE beyond the MOS: an in-depth look at QoE via better metrics and their relation to MOS. Quality and User Experience 1, 1 (2016), 2.Google ScholarCross Ref
- ITU-T. 2014. Estimating end-to-end performance in IP networks for data application.Google Scholar
- ITU-T. 2014. QoE factors in web-browsing.Google Scholar
- Conor Kelton, Jihoon Ryoo, Aruna Balasubramanian, and Samir R Das. 2017. Improving User Perceived Page Load Time Using Gaze. In Proc. of the USENIX Conference on Networked Systems Design and Implementation (NSDI). Google ScholarDigital Library
- Yun Ma, Xuanzhe Liu, Shuhui Zhang, Ruirui Xiang, Yunxin Liu, and Tao Xie. 2015. Measurement and Analysis of Mobile Web Cache Performance. In Proc. of the 24th International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Robert B Miller. 1968. Response time in man-computer conversational transactions. In Proc. AFIPS Fall Joint Computer Conference. ACM. Google ScholarDigital Library
- Ben Miroglio, David Zeber, Jofish Kaye, and Rebecca Weiss. 2018. The Effect of Ad Blocking on User Engagement with the Web. In Proc. of the 27th International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Yashar Moshfeghi and Joemon M. Jose. 2013. On Cognition, Emotion, and Interaction Aspects of Search Tasks with Different Search Intentions. In Proc. of the 22nd International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Fiona Fui-Hoon Nah. 2004. A study on tolerable waiting time: how long are web users willing to wait?Behaviour & Information Technology 23, 3 (2004), 153-163.Google Scholar
- Javad Nejati and Aruna Balasubramanian. 2016. An In-depth Study of Mobile Browser Performance. In Proc. of the 25th International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Ravi Netravali, Anirudh Sivaraman, Keith Winstein, Somak Das, Ameesh Goyal, and Hari Balakrishnan. 2014. Mahimahi: a lightweight toolkit for reproducible web measurement. In ACM SIGCOMM Computer Communication Review, Vol. 44. ACM, 129-130. Google ScholarDigital Library
- Jakob Nielsen. {n. d.}. Response Times: The 3 Important Limits. https://www.nngroup.com/articles/response-times-3-important-limits/.Google Scholar
- Ashkan Nikravesh, Hongyi Yao, Shichang Xu, David Choffnes, and Z. Morley Mao. 2015. Mobilyzer: An Open Platform for Controllable Mobile Network Measurements. In Proc. ACM MobiSys. Google ScholarDigital Library
- Ingmar Poese, Steve Uhlig, Mohamed Ali Kaafar, Benoit Donnet, and Bamba Gueye. 2011. IP Geolocation Databases: Unreliable?ACM SIGCOMM CCR 41, 2 (2011). Google ScholarDigital Library
- Peter Reichl, Sebastian Egger, Raimund Schatz, and Alessandro D'Alconzo. 2010. The logarithmic nature of QoE and the role of the Weber-Fechner law in QoE assessment. In Proc. IEEE International Conference on Communications (ICC).Google ScholarCross Ref
- Sanae Rosen, Bo Han, Shuai Hao, Z. Morley Mao, and Feng Qian. 2017. Push or Request: An Investigation of HTTP/2 Server Push for Improving Mobile Performance. In Proc. of the 26th International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Philipp Singer, Florian Lemmerich, Robert West, Leila Zia, Ellery Wulczyn, Markus Strohmaier, and Jure Leskovec. 2017. Why We Read Wikipedia. In Proc. of the 26th International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Chris Smith-Clarke and Licia Capra. 2016. Beyond the Baseline: Establishing the Value in Mobile Phone Based Poverty Estimates. In Proc. of the 25th International Conference on the World Wide Web (WWW). Google ScholarDigital Library
- Srikanth Sundaresan, Walter de Donato, Nick Feamster, Renata Teixeira, Sam Crawford, and Antonio Pescapè. 2011. Broadband Internet Performance: A View from the Gateway. In ACM SIGCOMM. 134-145. Google ScholarDigital Library
- Matteo Varvello, Jeremy Blackburn, David Naylor, and Konstantina Papagiannaki. 2016. EYEORG: A Platform For Crowdsourcing Web Quality Of Experience Measurements. In Proc. ACM CoNEXT. Google ScholarDigital Library
- Xiao Sophia Wang, Aruna Balasubramanian, Arvind Krishnamurthy, and David Wetherall. 2014. How Speedy is SPDY?. In Proc. of the USENIX Conference on Networked Systems Design and Implementation (NSDI). Google ScholarDigital Library
- Xiao Sophia Wang, Arvind Krishnamurthy, and David Wetherall. 2016. Speeding up Web Page Loads with Shandian. In Proc. of the USENIX Conference on Networked Systems Design and Implementation (NSDI). Google ScholarDigital Library
- Torsten Zimmermann, Jan Ruth, Benedikt Wolters, and Oliver Hohlfeld. 2017. How HTTP/2 Pushes the Web: An Empirical Study of HTTP/2 Server Push. In Proc. IFIP Networking.Google ScholarCross Ref
- Torsten Zimmermann, Benedikt Wolters, and Oliver Hohlfeld. 2017. A QoE Perspective on HTTP/2 Server Push. In Proc. ACM SIGCOMM, Internet-QoE Workshop. Google ScholarDigital Library
Recommendations
Perceived Performance of Top Retail Webpages In the Wild: Insights from Large-scale Crowdsourcing of Above-the-Fold QoE
Internet QoE '17: Proceedings of the Workshop on QoE-based Analysis and Management of Data Communication NetworksClearly, no one likes webpages with poor quality of experience (QoE). Being perceived as slow or fast is a key element in the overall perceived QoE of web applications. While extensive effort has been put into optimizing web applications (both in ...
Analyzing Wikipedia Users’ Perceived Quality of Experience: A Large-Scale Study
The Web is one of the most successful Internet applications. Yet, the quality of Web users’ experience is still largely impenetrable. Whereas Web performance is typically studied with controlled experiments, in this work we perform a large-scale ...
Understanding and estimating quality of experience in WebRTC applications
AbstractWebRTC comprises a set of technologies and standards that provide real-time communication with web browsers, simplifying the embedding of voice and video communication in web applications and mobile devices. The perceived quality of WebRTC ...
Comments