Vanessa Vella
ABSTRACT
Push notifications, which are at the core of most modern productivity and social tools, come in different shapes and sizes - all competing for one’s attention while creating the illusion of multitasking. At best, a notification may intervene in support of a primary task (e.g., a note about the correct use of a library), and at worst a notification may result in a complete context switch (e.g., answering an urgent and unrelated email). This paper presents a controlled single blind study conducted with 65 software professionals with the aim to further understand how different types of notifications may affect people during an immersive task. Insights are drawn from various angles, including mouse pointer logs, session recordings, temporal measures (e.g., time on task and time to resume task) as well as subjective workload assessments. Results indicate that participants who received either actionable or informational interventions managed to resume their tasks more efficiently than those who received actionable or informational intrusions. Actionable intrusions had a significant impact on overall task duration and levels of perceived effort while informational intrusions, which were largely ignored, had the largest impact on the participant’s ability to resume the task efficiently, which also resulted in high levels of frustration. The time to decide whether to engage with a notification was also a factor that contributed to the overall task duration, and this was particularly noticed when an actionable intervention was presented, resulting in a significant impact on mental demand and perceived performance.
- Piotr D Adamczyk and Brian P Bailey. 2004. If not now, when? The effects of interruption at different moments within task execution. In Proceedings of the SIGCHI conference on Human factors in computing systems. 271–278.Google Scholar
Digital Library
- Piotr D Adamczyk, Shamsi T Iqbal, and Brian P Bailey. 2005. A method, system, and tools for intelligent interruption management. In Proceedings of the 4th international workshop on Task models and diagrams. 123–126.Google ScholarDigital Library
- Shamel Addas and Alain Pinsonneault. 2015. The many faces of information technology interruptions: a taxonomy and preliminary investigation of their performance effects. Information Systems Journal 25, 3 (2015), 231–273.Google ScholarDigital Library
- Anja Baethge and Thomas Rigotti. 2013. Interruptions to workflow: Their relationship with irritation and satisfaction with performance, and the mediating roles of time pressure and mental demands. Work & Stress 27, 1 (2013), 43–63.Google ScholarCross Ref
- Jackson Beatty. 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources.Psychological bulletin 91, 2 (1982), 276.Google Scholar
- Monchu Chen and Veraneka Lim. 2013. Eye gaze and mouse cursor relationship in a debugging task. In International Conference on Human-Computer Interaction. Springer, 468–472.Google ScholarCross Ref
- Mihaly Csikszentmihalyi, Sami Abuhamdeh, Jeanne Nakamura, 1990. Flow.Google Scholar
- Barbara Anne Dosher. 1976. The retrieval of sentences from memory: A speed-accuracy study. Cognitive psychology 8, 3 (1976), 291–310.Google Scholar
- Andy Field. 2009. Discovering Statistics Using SPSS, Thrid Edition. (2009).Google Scholar
- Lucian Gonçales, Kleinner Farias, Bruno da Silva, and Jonathan Fessler. 2019. Measuring the cognitive load of software developers: a systematic mapping study. In 2019 IEEE/ACM 27th International Conference on Program Comprehension (ICPC). IEEE, 42–52.Google ScholarDigital Library
- Daniel Graziotin and Fabian Fagerholm. 2019. Happiness and the productivity of software engineers. In Rethinking Productivity in Software Engineering. Springer, 109–124.Google Scholar
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.Google Scholar
- Edward Cutrell Mary Czerwinski Eric Horvitz. 2001. Notification, disruption, and memory: Effects of messaging interruptions on memory and performance. In Human-Computer Interaction: INTERACT, Vol. 1. 263.Google Scholar
- Shamsi T Iqbal and Eric Horvitz. 2007. Disruption and recovery of computing tasks: field study, analysis, and directions. In Proceedings of the SIGCHI conference on Human factors in computing systems. 677–686.Google ScholarDigital Library
- Daniel C McFarlane and Kara A Latorella. 2002. The scope and importance of human interruption in human-computer interaction design. Human-Computer Interaction 17, 1 (2002), 1–61.Google ScholarDigital Library
- Abhinav Mehrotra, Veljko Pejovic, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2016. My phone and me: understanding people’s receptivity to mobile notifications. In Proceedings of the 2016 CHI conference on human factors in computing systems. 1021–1032.Google ScholarDigital Library
- André N Meyer, Gail C Murphy, Thomas Zimmermann, and Thomas Fritz. 2019. Enabling Good Work Habits in Software Developers through Reflective Goal-Setting. IEEE Transactions on Software Engineering(2019).Google ScholarCross Ref
- Tadashi Okoshi, Kota Tsubouchi, Masaya Taji, Takanori Ichikawa, and Hideyuki Tokuda. 2017. Attention and engagement-awareness in the wild: A large-scale study with adaptive notifications. In 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 100–110.Google ScholarCross Ref
- Antti Oulasvirta and Pertti Saariluoma. 2006. Surviving task interruptions: Investigating the implications of long-term working memory theory. International Journal of Human-Computer Studies 64, 10 (2006), 941–961.Google ScholarDigital Library
- Sabine Sonnentag, Leonard Reinecke, Jutta Mata, and Peter Vorderer. 2018. Feeling interrupted—Being responsive: How online messages relate to affect at work. Journal of Organizational Behavior 39, 3 (2018), 369–383.Google ScholarCross Ref
- Vanessa Vella and Chris Porter. 2021. Knock Brush! Perceived Impact of Push-based Notifications on Software Developers at Home and at the Office.. In VISIGRAPP (2: HUCAPP). 214–221.Google Scholar
- Robert J Youmans. 2011. Design fixation in the wild: Design environments and their influence on fixation. The Journal of Creative Behavior 45, 2 (2011), 101–107.Google ScholarCross Ref
- Minghui Zhou and Audris Mockus. 2010. Developer fluency: Achieving true mastery in software projects. In Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering. 137–146.Google ScholarDigital Library
- Fred RH Zijlstra, Robert A Roe, Anna B Leonora, and Irene Krediet. 1999. Temporal factors in mental work: Effects of interrupted activities. Journal of Occupational and Organizational Psychology 72, 2(1999), 163–185.Google ScholarCross Ref
Index Terms
- Wait a second! Assessing the impact of different desktop push notification types on software developers
Recommendations
Push the Red Button: Comparing Notification Placement with Augmented and Non-Augmented Tasks in AR
SUI '22: Proceedings of the 2022 ACM Symposium on Spatial User InteractionVisual notifications are omnipresent in applications ranging from smart phones to Virtual Reality (VR) and Augmented Reality (AR) systems. They are especially useful in applications where users performing a primary task have to be interrupted to react ...
Exploring software developers work practices
We studied IBM Jazz practitioners interactions and task performance.This work mined logs from 30,646 work items (WIs) created since 3 years by 474 practitioners.Software practitioners studied were mostly involved in fixing defects.The nature of the work ...
Notification in VR: The Effect of Notification Placement, Task and Environment
CHI PLAY '19: Proceedings of the Annual Symposium on Computer-Human Interaction in PlayVirtual reality (VR) is commonly used for entertainment applications but is also increasingly employed for a large number of use cases such as digital prototyping or training workers. Here, VR is key to present an immersive secondary world. VR enables ...
Comments