Skip to main content

Evaluating Remote Communication Applications Using Student Usability Reviews

  • Conference paper
  • First Online:
Computer-Human Interaction Research and Applications (CHIRA 2024)

Abstract

The paper investigates and assesses the user interface design of well-known remote communication applications (e.g., Zoom, Microsoft Teams, Google Meet) for improved user experience and interaction. University students evaluate the applications as part of a series of creative challenges, covering important HCI (Human-Computer Interaction) aspects such as existing affordances, visual variables, or interaction flows. The study contributes to an already-established literature review of the uses and effects of video-conferencing tools during and after the COVID-19 pandemic. With volunteer students as participants, they offer a new perspective for the research by acting both as users and evaluators. The study consisted of two connected experiments between early 2023 and 2024, learning and improving with each iteration transitioning from an ad-hoc qualitative-focus approach to a well-defined quantitative-centered tactic. The results for the first experiment showed that the participants preferred Zoom, Discord, and Webex as the top three choices out of nine distinct alternatives. The second experiment positioned Discord as the most advantageous of the final three-the application dominated with a Mean SUS (System Usability Scale) score of 77.42, and ranked first in six out of eight criteria (and one tie) using a custom rating scale.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    How to use Discord for your classroom – https://discord.com/blog/how-to-use-discord-for-your-classroom (Accessed on June 15, 2024).

  2. 2.

    Zoom Breakout Rooms – https://www.zoom.com/en/products/virtual-meetings/features/breakout-rooms/ (Accessed on June 15, 2024).

  3. 3.

    Discord Application Commands – https://discord.com/developers/docs/interactions/application-commands.

  4. 4.

    Responsive Design – https://www.interaction-design.org/literature/topics/responsive-design.

References

  1. Ahmad, S., Siddiqui, K.: Comparative study of alternative teaching and learning tools: google meet, microsoft teams, and zoom during COVID-19. In: Teaching in the Pandemic Era in Saudi Arabia, pp. 120–129 (2022). https://doi.org/10.1163/9789004521674_008

  2. Norman, D.: The Psychology of Everyday Things. Basic Books, New York (1988)

    MATH  Google Scholar 

  3. Morrison-Smith, S., Ruiz, J.: Challenges and barriers in virtual teams: a literature review. SN Appl. Sci. 2(6), 1–33 (2020). https://doi.org/10.1007/s42452-020-2801-5

    Article  MATH  Google Scholar 

  4. Sweller, J.: Cognitive load theory, learning difficulty, and instructional design. Learn. Instr. 4, 295–312 (1994). https://doi.org/10.1016/0959-4752(94)90003-5

    Article  Google Scholar 

  5. Garro-Abarca, V., Palos-Sanchez, P., Aguayo-Camacho, M.: Virtual teams in times of pandemic: factors that influence performance. Front. Psychol. 12, 624–637 (2021). https://doi.org/10.3389/fpsyg.2021.624637

    Article  Google Scholar 

  6. Hurst, W., Withington, A., Kolivand, H.: Virtual conference design: features and obstacles. Multimedia Tools Appl. 81, 16901–16919 (2022). https://doi.org/10.1007/s11042-022-12402-4

    Article  MATH  Google Scholar 

  7. Lucero, A.: Using affinity diagrams to evaluate interactive prototypes. In: Human-Computer Interaction-INTERACT 2015, vol. 9297 (2015). https://doi.org/10.1007/978-3-319-22668-2_19

  8. Accot, J., Zhai, S.: Performance evaluation of input devices in trajectory-based tasks: an application of the steering law. In: Proceedings Of ACM CHI 1999 Conference on Human Factors In Computing Systems, pp. 466–472 (1999). https://doi.org/10.1145/302979.303133

  9. Hick, W.: On the rate of gain of information. Q. J. Exp. Psychol. 4, 11–26 (1952). https://doi.org/10.1080/17470215208416600

    Article  Google Scholar 

  10. Fitts, P.: The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 381–391 (1954). https://doi.org/10.1037/0096-3445.121.3.262

    Article  MATH  Google Scholar 

  11. Allen, T., Golden, T., Shockley, K.: How effective is telecommuting? assessing the status of our scientific findings. Psychol. Sci. Public Interest 16, 40–68 (2015). https://doi.org/10.1177/1529100615593273

    Article  MATH  Google Scholar 

  12. Lee, Y.Y., Martin, K.I.: The flipped classroom in ESL teacher education: an example from CALL. Educ. Inf. Technol. 25(4), 2605–2633 (2019). https://doi.org/10.1007/s10639-019-10082-6

    Article  MATH  Google Scholar 

  13. Gumasing, M., Belizario, D., Reyes, M., Pacunayen, H., Piamonte, J.: Factors affecting preferences of web conferencing sites: a system usability study. In: Proceedings of the 2023 14th International Conference on E-Education, E-Business, E-Management and E-Learning, pp. 94–99 (2023). https://doi.org/10.1145/3588243.3588251

  14. Bhardawaj, A., Bhardwaj, R., Chaudhary, A.: A study on the effects of various video conferencing tools and apps for remote working during the COVID-19 pandemic. J. Remote Work 97, 1–10 (2023)

    Google Scholar 

  15. Mahyoob, M.: Online learning effectiveness during the COVID-19 pandemic: a case study of Saudi universities. Int. J. Inf. Commun. Technol. Educ. Off. Publ. Inf. Res. Manag. Assoc. 17, 1–14 (2021). https://doi.org/10.4018/IJICTE.20211001.oa7

    Article  MATH  Google Scholar 

  16. Chang, H., Varvello, M., Hao, F., Mukherjee, S.: A tale of three videoconferencing applications: zoom, webex, and meet. IEEE/ACM Trans. Network. 30(5), 2343–2358 (2022). https://doi.org/10.1109/TNET.2022.3171467

    Article  Google Scholar 

  17. Cóndor-Herrera, O., Jadán-Guerrero, J., Ramos, C.: Analysis of video conferencing platforms for online teaching during the Covid-19 pandemic. In: Proceedings of the 14th International Conference on Applied Human Factors and Ergonomics (AHFE 2022) (2022). https://doi.org/10.54941/ahfe1002378

  18. Archibald, M., Ambagtsheer, R., Casey, M., Lawless, M.: Using zoom videoconferencing for qualitative data collection: perceptions and experiences of researchers and participants. Int. J. Qual. Methods 18, 160940691987459 (2019). https://doi.org/10.1177/1609406919874596

  19. Mora-Jimenez, L., Ramírez-Benavides, K., Quesada, L., López, G., Guerrero, L.: User experience in communication and collaboration platforms: a comparative study including discord, microsoft teams, and zoom. In: Advances in Human Factors in Communication and Collaboration, pp. 52–61 (2022). https://doi.org/10.1007/978-3-030-96293-7_6

  20. Parasian, N., Yuliati, R.: Video conference as a mode of communication in the pandemic era. In: Proceedings of the 6th International Conference on Social and Political Sciences (ICOSAPS 2020), pp. 9–17 (2020). https://doi.org/10.2991/assehr.k.201219.002

  21. Matulin, M., Mrvelj, Š., Abramović, B., Šoštarić, T., Čejvan, M.: User quality of experience comparison between skype, microsoft teams and zoom videoconferencing tools. In: Proceedings of the International Conference on Communication Technologies and Applications (ICCTA 2021) (2021). https://doi.org/10.1007/978-3-030-78459-1_22

  22. Rio-Chillcce, A.D., Jara-Monge, L., Andrade-Arenas, L.: Analysis of the use of videoconferencing in the learning process during the pandemic at a University in Lima. Int. J. Adv. Comput. Sci. Appl. 12(5) (2021). https://doi.org/10.14569/IJACSA.2021.01205102

  23. Karl, K.A., Peluchette, J.V., Aghakhani, N.: Virtual Work Meetings During the COVID-19 pandemic: the good, bad, and ugly. Small Group Res. 53(3), 343–365 (2022). https://doi.org/10.1177/10464964211015286

    Article  Google Scholar 

  24. Flame, R.R.F., Prasetyo, Y.T., Nadlifatin, R., Ayuwati, I.D., Persada, S.F., Chuenyindee, T.: Usability evaluation of communication tools used as remote support in machine service industry: a comparison between microsoft teams and skype. In: Proceedings of the 2023 6th International Conference on Computers in Management and Business (ICCMB ’23), pp. 117–121 (2023). https://doi.org/10.1145/3584816.3584834

  25. Bridson, K., Atkinson, J., Fleming, S.D.: Delivering round-the-clock help to software engineering students using discord: an experience report. In: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education, vol. 1 (SIGCSE 2022), pp. 759–765 (2022). https://doi.org/10.1145/3478431.3499385

  26. Cuijpers, J., et al.: An empirical evaluation of video conferencing systems used in industry, academia, and entertainment. In: Companion of the ACM/SPEC International Conference on Performance Engineering (ICPE ’21), pp. 171–174 (2021). https://doi.org/10.1145/3447545.3451174

  27. Balogova, K., Brumby, D.: How do you zoom?: a survey study of how users configure video-conference tools for online meetings. In: Proceedings of the 1st Annual Meeting of the Symposium on Human-Computer Interaction for Work (CHIWORK ’22), Article No. 5, pp. 1–7 (2022). https://doi.org/10.1145/3533406.3533408

  28. Schrepp, M., Hinderks, A., Thomaschewski, J.: Applying the user experience questionnaire (UEQ) in different evaluation scenarios. In: Proceedings of the International Conference on Design, User Experience, and Usability, pp. 383–392 (2014). https://doi.org/10.1007/978-3-319-07668-3_37

  29. Vargas-Murillo, A.R., Pari-Bedoya, I.N.M.D.L.A., Guevara-Soto, F.D.J.: The Ethics of AI assisted learning: a systematic literature review on the impacts of ChatGPT usage in education. In: Proceedings of the 2023 8th International Conference on Distance Education and Learning (ICDEL 2023), pp. 8–13. Association for Computing Machinery, New York (2023). https://doi.org/10.1145/3606094.3606101

Download references

Acknowledgements

The study was possible with the contribution of the participants who volunteered. Gratitude and appreciation are in order. A special mention also goes to Prof. Dr. habil. Sabin-Corneliu Buraga for his support while making this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alecsandru Grigoriu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Grigoriu, A. (2025). Evaluating Remote Communication Applications Using Student Usability Reviews. In: Plácido da Silva, H., Cipresso, P. (eds) Computer-Human Interaction Research and Applications. CHIRA 2024. Communications in Computer and Information Science, vol 2370. Springer, Cham. https://doi.org/10.1007/978-3-031-82633-7_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-82633-7_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-82632-0

  • Online ISBN: 978-3-031-82633-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics